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PREFACE 


This  report  presents  the  findings  of  a  research  project  entitled 
"Field  Validation  of  Statistically-Based  Acceptance  Plan  for  Bituminous 
Airport  Pavements",  Report  No.  DOT/FAA/PM-84/12,  that  was  conducted  to 
investigate  the  use  of  Marshall  properties  for  acceptance  purposes.  The 
results  of  the  research  effort  are  presented  in  the  series  of  reports 
listed  below: 


Burati,  J.L.,  Brantley,  G.D.  and  Morgan,  F.W.,  "Correlation 
Analvsis  of  Marshall  Properties  of  Laboratory-Compacted  Specimens," 
Final  Report,  Volume  1,  Federal  Aviation  Administration,  May, 

1984. 

Burati,  J.L.,  Seward,  J.D.  and  Busching,  H.W.,  "Statistical 
Analysis  of  Marshall  Properties  of  Plant-Produced  Bituminous 
Materials,"  Final  Report,  Volume  2,  Federal  Aviation 
Administration,  May,  1984. 

Burati,  J.L.  and  Seward,  J.D.,  "Statistical  Analysis  of  Three 
Methods  for  Determining  Maximum  Specific  Gravity  of  Bituminous 
Concrete  Mixtures,"  Final  Report.  Volume  3,  Federal  Aviation 
Administration,  May,  1984. 

Nnaji,  S.,  Burati,  J.L.  and  Tarakji,  M.G.,  "Computer  Simulation  of 
Multiple  Acceptance  Criteria,"  Final  Report.  Volume  4,  Federal 
Aviation  Administration,  August,  1984. 

Burati,  J.L.,  Busching,  H.W.  and  Nnaji,  S.,  "Field  Validation  of 
Statistically-Based  Acceptance  Plan  for  Bituminous  Airport 
Pavements  —  Summary  of  Validation  Studies,"  Final  Report,  Volume 
5,  Federal  Aviation  Administration,  September,  1984. 

The  application  of  multiple  price  adjustments  is  significantly  more 
involved  than  the  case  when  only  one  property,  e.g.,  density,  is 
considered.  Since  the  Marshall  properties  (i.e.,  stability,  flow  and 
air  voids)  are  physically  related,  they  can  be  expected  to  be 
statistically  correlated.  If  this  is  truly  the  case,  then  it  may  not  be 
sufficient  to  treat  each  of  the  three  properties  individually.  It  is 
necessary  to  determine  whether  correlations  exist  among  these 
properties,  and  whether  such  correlations  should  be  considered  when 
developing  acceptance  plans. 

The  objectives  of  the  research  described  in  the  reports  listed 
above  include: 

1.  Review  current  methods  for  determining  maximum  specific  gravity 
for  use  in  air  voids  calculations  for  possible  incorporation  into 
the  FAA  Eastern  Region  P-401  specification, 


2.  Investigate  the  use  of  price  adjustments  when  more  than  one 
characteristic  is  being  used  for  acceptance  purposes  and  recommend 
to  the  FAA  potential  procedures  for  dealing  with  multiple  price 
adjustments, 

3.  Develop  the  procedures  necessary  to  evaluate  the  performance  of 
multiple  properties  acceptance  plans, 

4.  Implement  proposed  Marshall  properties  acceptance  plans  on 
demonstration  projects  under  field  conditions,  and 

5.  Attempt  to  correlate  values  of  asphalt  content  and  aggregate 
gradation  with  those  from  Marshall  tests  to  determine  whether  or 
not  correlations  exist  among  these  properties. 

This  report,  Volume  4,  presents  the  results  of  computer  simulation 
analyses  used  in  the  development  and  evaluation  of  multiple-property 
price  adjustment  systems.  The  results  of  laboratory  analyses  and  an 
analysis  of  field  data  for  the  correlation  among  the  Marshall  properties 
are  presented  in  Volumes  1-3. 


CHAPTER  I 


INTRODUCTION 


In  the  early  1960's,  a  new  philosophy  with  respect  to  the  bases, 
language,  understanding,  and  enforcement  of  the  quality  control  of 
asphalt  pavements  evolved.  The  new  philosophy  recognized  3  previously 
neglected  aspects  of  quality  control: 

1.  specifications  should  account  for  the  inherent  variability  of 
the  materials  and  the  testing  procedures, 

2.  specifications  should  be  more  concerned  with  the  end  result 
rather  than  the  resources  used  and  the  procedures  followed,  and 

3.  contract  responsibilities  and  authority  should  be  divided 
fairly  between  the  owner  (and/or  his  representative  at  the  site) 
and  the  contractor. 

State  highway  departments  began  incorporating  these  concepts  into 
specifications  in  the  form  of  end-result  statistically-based 
specifications  as  early  as  the  late  1960's.  The  Federal  Aviation 
Administration  (FAA)  Eastern  Region,  for  the  first  time  incorporated 
statistically-based  acceptance  approaches  in  its  bituminous  surface 
course  specifications  (Item  P-401)  during  the  1978  paving  season. 

In  1980,  the  FAA  Eastern  Region  incorporated  a  statistically-based 
price  adjustment  schedule  for  the  mat  density  of  asphalt  pavements  based 
on  an  FAA-sponsored  research  project  (1).  However,  the  final  report  of 
that  research  project  did  not  offer  a  multiple  price  adjustment  system 
for  all  the  acceptance  variables  (Marshall  stability,  flow,  and  air 
voids,  and  mat  density)  that  the  FAA  desired.  The  final  report  did  not 
recommend  a  multiple  price  adjustment  system  for  all  the  acceptance 
variables  because  these  variables  are  known  to  be  physically  related  and 
further  study  was  needed  to  quantify  and  analyze  these  relationships 
before  recommending  such  a  price  adjustment  system.  Correlatons  are 
important  in  developing  a  price  adjustment  schedule  because  they  measure 
the  variation  of  one  variable  relative  to  that  of  another.  Hence,  if 
the  correlation  between  2  variables  is  ignored  and  the  2  variables  are 
treated  independently,  the  inter-relationship  of  the  2  variables  will 
not  be  taken  into  account,  possibly  resulting  in  partially  measuring  the 
same  material  characteristic  twice. 

Scope 

The  terra  'asphalt  pavements'  refers  to  many  different  types  of 
paving  courses  designed  for  different  uses  and  based  on  different 
properties  of  the  mixture  and  the  components.  It  is  used  in  this  report 
to  denote  plant-produced,  hot-mixed,  hot-laid,  dense-graded  bituminous 
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For  the  bivariate  case,  the  pdf  is: 


£(z)  =  - ,  {exp  -0.5 

(  2  -  )  |  C  |  2 


where  Cll  =  C22  =  1.0, 

C12  =  C21  =  correlation  between  the  2  variables, 

which  can  be  simplified  to  (11): 


f(z)  =  - —  exp(Gz) 

(  2  TT  )  (1-P2)^ 

where  Gz  =  0.5  [1/{1-(P*P) } ]*[ (Z1*Z1)  -  2^P^( Z 1 *Z2 )  +  (Z2*Z2)], 

P  =  C12  =  correlation  between  Z1  and  Z2. 

Figures  3,  4,  and  5  show  the  shape  of  -he  bivariate  normal 
distribution  with  zero  correlation,  positive  correlation  (P  =  0.6),  and 
negative  correlation  (P  =  -0.6),  respectively.  The  shape  of  the 
bivariate  normal  distribution  is  relevant  to  the  volume  beneath  it 
(PWL).  For  example,  the  PWL  under  the  bivariate  normal  curve  between 
minus  infinity  and  zero  for  both  variables  is  0.25  for  zero  correlation, 
0.35  for  +0.6  correlation,  and  0.1' 3  for  -0.6  correlaton.  Figures  6,  7, 
and  8  show  contours  for  the  bivariate  pdf's.  The  shape  of  the 
trivariate  normal  distribution  can  not  be  shown  because  it  is  a  4 
dimensional  volume  in  Euclidean  space. 
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When  Cxy  has  a  numeric  value  of  0.0  the  2  variables  are  said  to  be 
uncorrelated  and  can,  therefore,  be  treated  separately.  When  Cxy  Las  a 
numeric  value  of  1.0  or  -1.0  the  2  variables  are  sail  to  have  perfect 
correlation.  That  is,  all  the  variation  in  one  can  be  predicted  exactl 
by  the  variation  of  the  other. 

Multivariate  Normal  Distributions 


The  multivariate  normal  distribution  for  n  variables  with  a  mean 
vector  M  and  covariance  matrix  V  (non-singular)  is  defined  by  the 
following  probability  density  function  (pdf): 

f(X)  =  (.2-rr)~k/-  |  Vp1/2  exp  { -0 . 5  (  [X~M]T  [  V  ] ' 1 


where 


[VJ  =  matrix  or  vector  V, 

I V f  =  determinant  of  V, 

X  =  correlated  normal  variates  vector, 
M  =  means  vector, 

T  =  transposed  matrix  operation 
k  =  number  of  variables. 


For  the  standardized  multivariate  normal  distribution  having  means 
equal  to  zero  and  variances  equal  to  1.0,  the  pdf  becomes: 

f ( x )  =  (2m)  ~k/2  |  C  f1/2  exp  j-0.5([Z]T  [C]-1  [Z])} 

where  Z  =  standardized  variates  vector, 

C  =  correlation  matrix  (matrxX  of  correlation  coefficients 
of  the  variables). 


For  the  trivariate  case,  the  pdf  is: 

f(z)  =  - - -  exp  (-0 ,5(  [  Z  ]T[C  r1  LZ])  } 

( 2-rr)  3/2  |  c  |1  /2 


where 

[Z]  = 

[  Z1 

Z2 

Z3  ] 

1 

Cll 

C12 

Cl  3 

[C]  = 

C21 

C22 

C23 

f 

C31 

C32 

C33 

Cll  =  C22  =  C33  =  1.0, 

C12  =  C21  =  correlation  between  variates  1  and  2, 
C13  =  C31  =  correlation  between  variates  1  and  3, 
C23  =  C32  =  correlation  between  variates  2  and  3. 
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CHAPTER  II 


STATISTICAL  BASIS 


In  the  process  of  developing  an  acceptance  plan  for  the  Marshall 
properties,  it  is  important  to  base  the  plan  on  the  results  of  a  large 
number  of  data  points.  Because  it  is  infeasible  to  actually  perform  the 
large  number  of  Marshall  tests  required,  it  is  important  to  be  able  to 
generate  hypothetical  test  results.  One  way  to  generate  such  results  is 
by  computer  simulation.  The  computer  simulation  process  (Chapter  III) 
requires  a  random  number  generator  routine,  a  random  normal  number 
converter  routine,  and  a  matrix  decomposition  algorithm.  Previous 
research  (4)  has  shown  that  it  is  acceptable  to  assume  that  the  3 
Marshall  properties  (stability,  flow,  and  air  voids)  have  individual 
normal  distributions.  Since  these  properties  vary  simultaneously,  and 
are  therefore  physically  related,  it  is  reasonable  to  assume  that  the  3 
together  have  a  trivariate  normal  distribution. 

It  is  shown  in  Chapter  I  that  the  PWL  of  a  function  with  2  or  more 
variables  is  a  volume  in  Euclidean  space.  Thus,  to  calculate  the  PWL 
for  the  Marshall  properties,  it  is  necessary  to  integrate  the  trivariate 
normal  probability  density  function  (pdf).  This  integral,  the 
trivariate  normal  cumulative  distribution  function  (CDF),  can  not  be 
obtained  analytically.  Consequently,  the  only  practical  way  to 
determine  the  trivariate  PWL  is  by  numerical  integration. 

Correlation  Coefficient 


The  correlation  coefficient  is  a  measure  of  the  linear  association 
between  variables.  The  mathematical  equation  for  the  correlation 
between  2  variables  X  and  Y,  Cxy,  is  given  by: 


Cxy 


E  (Xi-x)  *  (Yi-y) 
f  E.  (Xi-x) 2  *  l  (yi-y) 2  ]* 


where  Cxy  is  the  correlation  coefficient 

XI,  X2  ...  Xi  ...  Xn  are  the  observations  for  X, 
Yl,  Y2  ...  Yi  ...  Yn  are  the  observations  for  Y, 

x  is  the  mean  of  X, 

y  is  the  mean  of  Y. 
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Table  4.  Experimental  Design  and  Number  of  Replicates  Used  in  Marshall 
Laboratory  Analysis  (3) 


Asphalt  Content  {%) 


Gradation 

5.0 

5.5 

6.0 

6.5 

7.0 

7.5 

A 

12 

12 

12 

12 

12 

12 

B 

12 

12 

12 

12 

12 

12 

C 

12 

12 

12 

12 

12 

12 

D 

12 

12 

12 

12 

12 

12 

2.  1978  Paving  Projects  On  Which  Data  Were  Collected  (1) 


Project 


Adirondack-A* 

Adirondack-B* 

Chari ottesville-ANJ# 

Charlottesville-SLW* 

Chautauqua 

Chemung-Chemung* 

Chemung-Fisherville* 

DuBois 

Dutchess 

Linden 

Westchester-Col provi 
Westchester-Peckham* 


Location 


a* 


Saranac  Lake,  NY 
Saranac  Lake,  NY 
Charlottesville, 
Charlottesville, 
Jamestown,  NY 
Elmira,  NY 
Elmira,  NY 
DuBois,  PA 
Poughpkeepsie,  NY 
Linden,  NJ 
White  Plains,  NY 
White  Plains,  NY 


VA 

VA 


iese  projects  two  asphalt  plants,  each  with  a  different  JMF,  l 


981  Paving  Projects  On  Which  Data  Were  Collected  (2) 


Location 


Baltimore,  MD 


Project 


Baltimore  Washington 
International  (BWI) 


National  Aviation  Facilities 
Experimental  Center 
(NAFEC ) ,  Atlantic  City 


Pamona,  NJ 


Monroe  County  Airport 
(Rochester) 


Rochester,  NY 


Sources  of  Data 


A  total  of  288  laboratory  samples  along  with  data  from  15  runway 
paving  projects  were  used  in  this  study.  The  data  used  are  from  the 
following  sources: 

1.  Field  data,  collected  by  Burati  and  Willenbrock  (1),  from  12 
paving  projects  provided  by  the  FAA  Eastern  Region  during  the  1978 
paving  season.  The  projects  and  their  locations  are  listed  in 
Table  2. 

2.  Field  data,  collected  by  Burati  and  Seward  (2),  from  3  paving 
projects  provided  by  the  FAA  Eastern  Region  during  the  1981 
construction  season.  These  projects  and  their  locations  are  listed 
in  Table  3. 


3.  Laboratory  data  from  24  bituminous  concrete  mixtures,  12 
replicates  per  mixture,  prepared  and  tested  by  Brantley  (3).  The 
experimental  design  for  these  data  is  shown  in  Table  4. 


Test  Item3 


Lower  Limit 


Upper  Limit 


Stability  (pounds) 
Flow  (0.01  inches) 
Air  Voids  {%) 

Mat  Density*3  (.%) 


1800 

8 

2 

96.7 


none 

16 

5 

none 


concrete  prepared  according  to  the  FAA  Eastern  Region's  specifications 
to  be  used  in  surfacing  airport  runways,  taxiways  and  aprons. 

The  FAA  specifications  use  the  Marshall  stability,  flow  and  air 
voids  as  acceptance  criteria  for  plant  mixtures;  and  the  pavement 
density,  thickness,  smoothness  and  grade  for  the  construction 
workmanship.  Furthermore,  the  FAA  requires  the  contractor  to  correct 
any  deficiencies  in  the  pavement's  thickness  and  surface  conditions 
(P-401).  Consequently,  these  items  are  not  included  in  this  study 
because  they  are  treated  by  the  FAA  as  correctable,  and  are  not 
considered  for  price  adjustments.  Table  1  presents  the  FAA  acceptance 
limits  for  Marshall  stability,  flow  and  air  voids  and  for  mat  density. 

Research  Objectives 

The  goal  of  this  study  is  to  formulate  a  procedure  for  the 
acceptance  and  the  application  of  price  adjustment  factors  to  asphalt 
airport  pavements  using  the  acceptance  variables  currently  used  by  the 
FAA  Eastern  Region.  This  goal  has  the  following  specific  objectives: 

1.  Study  the  correlation  structure  between  the  3  Marshall 
properties  (stability,  flow  and  air  voids)  and  their  effect  on  the 
acceptance  criteria  of  asphalt  pavements. 

2.  Develop  an  algorithm  to  measure  the  quality  of  the  pavement  as 
a  function  of  the  3  Marshall  properties. 

3.  Investigate  the  adequacy  of  present  heuristic  methods  for 
evaluating  compliance  using  more  than  one  acceptance  property. 

The  PWL  Concept 

The  percentage  within  limits  (PWL)  is  a  concept  used  in 
statistically-based  acceptance  plans  to  incorporate  both  the  mean  and 
the  variability  of  the  test  results  in  determining  the  acceptability  of 
the  lot.  The  PWL  represents  the  percentage  of  the  lot  falling  within 
the  acceptance  limits.  Thus,  for  the  2  dimensional  case  of  a  single 
variable  such  as  density,  the  PWL  is  the  area  under  the  density 
distribution  function  of  the  variable  between  the  upper  and  the  lower 
limits  of  acceptance  specified  for  that  variable  (Figure  1).  For  the  3 
dimensional  case  of  2  variables,  the  PWL  is  the  volume  under  the 
bivariate  distribution  surface  between  the  4  acceptance  limits  (one 
upper  and  one  lower  limit  for  each  variable).  Figure  2  shows  the  volume 
representing  the  PWL  of  2  variables.  For  more  than  2  variables,  the  PWL 
is  a  volume  in  Euclidean  space  bounded  by  the  upper  and  lower  limits  for 
each  variable. 


CHAPTER  III 


NUMERICAL  COMPUTATIONAL  PROCEDURES 


In  this  chapter,  the  numerical  computational  procedures  used  in 
developing  the  multivariate  acceptance  plan  are  described.  These 
include: 


1.  multivariate  computer  simulation  to  generate  hypothetical 
Marshall  test  results,  and 

2.  numerical  integration  to  obtain  a  measure  of  the  quality  of  the 
asphalt  mixture  in  terms  of  the  trivariate  PWL. 

Multivariate  Computer  Simulation 

Random  normal  variates  can  be  generated  using  different  techniques. 
The  central  limit  theorem,  the  Box-Muller  method  and  the  Morsaglia  polar 
method  (5)  are  some  of  these  techniques.  The  Morsaglia  polar  method, 
which  is  a  modification  of  the  Box-Muller  method,  was  selected  for  use 
in  this  study  due  to  its  superiority  in  a  preliminary  evaluation.  Table 
5  shows  the  performance  of  function  RNOR  (6),  which  is  based  on  the 
Morsaglia  polar  method,  and  subroutine  GAUSS  from  IBM's  Scientific  and 
Statistical  Package  (7),  which  is  based  on  the  central  limit  theorem, 
for  500  simulations. 

The  simulation  of  correlated  normal  variates  can  be  accomplished  by 
the  following  matrix  operations:  let  [Z]  be  a  vector  of  random  normal 
variates  of  size  m,  [V]  a  vector  of  means  of  size  m,  [C]  a  covariance 
matrix  of  size  m*m,  and  [R]  a  lower  triangular  matrix  such  that  [R]  * 
[R]T  =  [C] . 

Then, 


[X]  =  [V]  +  ([Z]  *  [R]) 

is  a  vector  of  correlated  random  normal  variates  (8).  The  Cholesky 
Sequential  Decomposition  Algorithm,  CSDA,  converts  a  matrix,  [C],  to  a 
lower  triangular  matrix,  [R].  Subroutine  CSDA  was  tested  by  simulating 
1000  Marshall  tests  using  the  statistics  of  each  of  the  1978  projects  as 
population  values.  The  3  mean  simulated  correlation  coefficients  for 
each  project  (a  total  of  36  correlation  coefficients  for  the  12 
projects),  were  calculated  and  compared  with  the  population 
correlations.  As  shown  in  Figure  9,  the  maximum  difference  between  the 
population  correlations  and  the  simulated  correlatons  is  less  than  0.10, 
and  the  majority  of  these  differences  range  between  0.00  and  0.06. 

These  small  differences  indicate  that  subroutne  CSDA  is  an  acceptable 
generator  of  correlated  random  normal  numbers. 


Table  5.  Performance  of  the  Central  Limit  Theorem  and  the  Morsaglia  Polar 
Method  for  Generating  500  Pseudo-Normal  Random  Numbers 


Central  Limit 

Morsaglia 

Limit  Theorem 

Polar  Method 

Average  Error 
in  Mean 

0.0444 

0.01 49 

Average  Error 
in  Standard 

Deviation 

0.0236 

0.0004 

Computer  Execution 

Time  (seconds) 

0.41 

0.09 

ABSOLUTE  DIFFERENCE 


Figure  9.  Histogram  of  the  Differences  Between  the 
Simulated  Correlations  and  the  True  Correlations  Between 
the  Marshall  Properties  of  the  1978  Paving  Projects  Using 
Subroutine  CSDA. 


Numerical  Integration 

The  integral  of  a  continuous  non-negative  function  f(x),  with  a 
closed  interval  domain  (a,b),  is  the  area  of  the  region  under  the  curve 
betweeen  the  2  vertical  lines  x=a  and  x=b.  For  example,  if  f(x)=x,  then 
7f(x)  d(x)  is  the  area  under  the  45  degree  line  between  x=a  and  x=b. 


For  functions  with  more  than  one  variable,  Davis  (9)  recommends  the 
use  of  the  Cartesian  products  and  product  rule  to  obtain  the  volume  in 
Euclidean  space  that  corresponds  to  the  double  or  higher  level  integral. 
To  illustrate  this  approach  using  vector  notation,  let  B  be  a  region 
with  points  X=(xj,x  2  ....  xn)  and  G  be  a  region  with  points  Y*(yj,y2 
.  yn),  then 

/ f(x)  dv  =  (1/m)  E  w ^  f(xi), 

/ f(y)  dv  =  (1/m)  E  Vj  f(yj), 

Volume  =  /  f(x,y)  dv  =  (l/m)  EE  w.^  v^  f (x^  , y j )  . 

where  w^  and  Vj  are  the  weights  from  the  compound  Simpson's  rule, 

m  is  the  total  number  of  weights 


f(xi,yj)  is  the  value  of  the  function  at  X=x^  and  Y=y^  . 
The  weighted  values  can  be  obtained  using  the  following  relation: 


W  ®  n  w(i) . 

Subroutine  SUM,  shown  in  Appendix  D,  calculates  the  weighted 
average  for  functions  with  any  number  of  variables.  This  subroutine  was 
adapted  from  Davis  (9) . 


Numerical  Integration  Boundaries 

For  the  one  degree  normal  distribution,  99.73  percent  of  the  area 
under  the  curve  lies  within  3  standard  deviations  from  the  mean.  When 
numerical  integration  is  used,  the  boundary  limits  should  be  carefully 
selected.  If  they  are  too  close  to  the  mean,  significant  areas  in  the 
tails  will  be  lost.  If  they  are  too  far  from  the  mean,  the  function 
will  be  evaluated  at  too  many  points  in  the  extreme  portions  of  the 
tails  where  the  function  value  is  practically  zero.  This  results  in 
underestimating  the  weighted  average  of  the  function.  The  area  depends 
on  both  the  integration  interval  and  the  weighted  average  value  of  the 
function. 


To  select  boundary  limits  for  the  multivariate  normal  distribution, 
the  volume  in  Euclidean  space  under  the  trivariate  normal  distribution 
for  the  zero  correlations  case  was  calculated  for  various  boundary 
limits  (Table  6).  The  boundary  limit  standing  for  infinity  was  selected 
to  be  3.5  standard  deviations  because  the  volume  calculated  by  numerical 
integration  for  variate  intervals  [-3.5,  +3.5]  was  0.9949  which  is  very 
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close  to  the  theoretical  value  (the  product  of  the  3  individual  areas  as 
obtained  from  normal  distribution  tables),  0.9988,  and  close  to  the 
total  volume  under  the  surface  which  is  1.0.  The  same  conclusion  was 
made  when  the  upper  limits  were  taken  as  zeros.  Selection  of  -3.5  as  a 
lower  limit  standing  for  minus  infinity  gave  a  volume  of  0.1248.  This 
is  close  to  both  the  theoretical  value  (0.1249)  and  the  total  volume  of 
0.125  for  the  region  from  minus  inifinity  to  zero. 

Selection  of  the  Integration  Rule 

The  17-point  integration  rule  (evaluating  the  function  at  a  grid  of 
17  points  in  each  dimension)  was  selected  for  2-degree  numerical 
integration.  The  9-point  integration  rule  was  selected  for  3-degree 
numerical  integration.  It  was  found  that  accurate  results  could  be 
obtained  at  these  levels.  Using  more  points  does  not  significantly 
increase  the  accuracy  of  the  results,  but  does  dramatically  increase 
computer  execution  time.  Tables  7  and  8  show  the  integration  results 
for  the  standardized  bivariate  normal  distribution  and  the  standardized 
trivariate  normal  distribution  for  variate  intervals  [-3.0,  +3.0]  and 
zero  correlations. 

Because  the  variates  are  uncorrelated,  the  theoretical  values 
corresponding  to  the  integration  intervals  used  can  be  calculated  from  a 
normal  distribution  table  (Appendix  A)  by  multiplying  the  corresponding 
variate  areas.  Thus,  for  variate  intervals  [-3.0,  +3.0],  the  volume 
under  the  bivariate  normal  surface  is  0.9974  *  0.9974  =  0.9948,  and  the 

volume  under  the  trivariate  normal  surface  is  0.9974  *  0.9974  *  0.9974 
=  0.9922. 

The  fact  that  a  higher  integration  rule  was  selected  for  the 
2-degree  case  than  for  the  3-degree  case  can  be  explained  by  the  fact 
that  the  bivariate  17-point  rule  evaluates  the  integral  at  289  (17  *  17) 
points,  while  the  trivariate  9-point  rule  evaluates  the  integral  at  729 
(9*9*9)  points. 


Table  6.  Volumes  Under  the  Trivariate  Normal  Distribution  for  the  Zero 
Correlations  Case  Using  Different  Integration  Intervals 


Lower 

Boundary 

Limi ts 

Upper 

Boundary 

Limits 

Numerical 

Integration 

Volume 

Theoretical3 

Volume 

(Tables) 

-3.5 

3.5 

0.9949 

0.9988 

-3.0 

3.0 

0.9908 

0.9922 

-3.5 

0.0 

0.1248 

0.1249 

-3.0 

0.0 

0.1240 

0.1240 

a  The  total  Volume  under  the  surface  from  minus  infinity  to  plus  infinity 
for  all  three  variables  is  1.0,  and  the  total  Volume  under  the  surface 
from  minus  infinity  to  zero  for  all  three  variables  is  0.125. 


Table  7.  Numerical  Integration  Results  for  the  Bivariate  Normal 

Distribution  for  Standardized  Variate  Intervals  [  —  3 - 0 ,  +3.0]  and 
Zero  Correlation 


Integration 

Points  Rule 

Number  of  Points 
of  Function  Evaluation 

Volume3 

3 

9 

2.57615 

5 

25 

1.62293 

9 

81 

1.22030 

17 

289 

0.99506 

33 

1  ,089 

0.99509 

aTheoretical  Volume  =  0.9948 


Table  8.  Numerical  Integration  Results  for  the  Trivariate  Normal 

Distribtuion  for  Standardized  Variate  Intervals  [-3.0,  +3.0]  and 
Zero  Correlations 


Integration 

Points  Rule 

Number  of  Points 
of  Function  Evaluation 

Volume3 

5 

125 

2.06752 

9 

729 

0.991 61 

17 

4,913 

0.99203 

aTheoretical  Volume  =  0.9922 


CHAPTER  IV 


DATA  ANALYSIS 


Marshall  data  from  the  1978  and  1981  paving  projects  were  analyzed 
to  calculate  the  means,  standard  deviations,  correlation  coefficients, 
and  the  trivariate  PWLs  (the  3-degree  numerical  integration  of  the 
trivariate  normal  distribution  using  the  FAA  acceptance  values  for 
stability,  flow,  and  air  voids  as  the  integration  interval  boundaries) 
for  each  project.  Tables  9-12  present  the  means,  standard  deviations, 
correlation  coef fficients,  and  PWL  values  for  the  1978  projects.  Tables 
13-16  present  the  statistics  for  the  1981  paving  projects. 

Laboratory  data  obtained  by  Brantley  (4)  were  also  used  to  study 
the  correlation  coefficients  and  their  variation.  Brantley  investigated 
the  variation  of  the  Marshall  correlations  as  a  function  of  asphalt 
content  and  aggregate  gradation.  Table  17  lists  the  correlation 
coefficients  for  the  laboratory  data  for  stability  and  flow,  stability 
and  air  voids,  and  flow  and  air  voids. 

General  Trends 


The  standard  deviations  from  the  1981  paving  projects  are  generally 
lower  than  those  for  the  1978  paving  projects.  For  the  1981  proejcts, 
the  pooled  standard  deviations  for  stability,  flow,  and  air  voids  are 
244,  0.84,  and  0.62,  respectively.  For  the  1978  projects,  the 
corresponding  standard  deviations  are  279,  1.81  and  0.75,  respectively. 
However,  the  values  for  1981  are  lower  due  to  the  results  from  the 
Baltiraore-Washington  project.  The  standard  deviations  for  this  project, 
particularly  for  stability  and  air  voids,  are  quite  low,  and  may  not  be 
indicative  of  typical  projects.  However,  the  fact  that  the  magnitudes 
of  the  standard  deviations  are  low  does  not  necessarily  indicate  that 
the  correlations  among  the  results  are  not  appropriate.  For  this 
reason,  it  was  decided  to  include  this  project  among  those  analyzed  in 
the  simulation  analyses. 

In  both  the  field  and  laboratory  data,  there  is  a  strong  tendency 
for  the  correlation  between  stability  and  flow,  C(s,f),  to  be  positive, 
for  the  correlation  between  stability  and  air  voids,  C(s,v),  to  be 
negative,  and  for  the  correlation  between  flow  and  air  voids,  C(f,v), 
also  to  be  negative. 

For  the  1981  projects,  C(s,f)  had  2  positive  values  and  1  negative 
value,  C(s,v)  had  3  negative  values  and  no  positive  values,  and  C(f,v) 
had  2  negative  values  and  1  positive  value  (Table  15).  For  the  1978 
projects,  C(s,f)  had  9  positive  values  and  3  negative  values,  C(s,v)  had 
10  negative  values  and  2  positive  values,  and  C(f,v)  had  11  negative 
values  and  1  positive  value  (Table  11).  These  results  are  consistent 
with  the  laboratory  correlatons  which  have  19  positive  values  and  5 


negative  values  for  C(s,f),  21  negative  values  and  3  positive  values  for 
C(s,v),  and  20  negative  values  and  4  positive  values  for  C(f,v)  (Table 
17). 


To  calculate  representative  correlations  for  the  field  data,  the 
correlation  values  from  both  sources  of  field  data  for  which  the  sign 
(positive  or  negative)  did  not  agree  with  the  general  trend  were  deleted 
and  the  averages  of  those  remaining  were  calculated.  For  C(s,f),  there 
were  11  positive  values  with  a  mean  of  0.278  which  was  rounded  to  0.30. 
For  C(s,v),  there  were  13  negative  values  with  a  mean  of  -0.396  which 
was  rounded  to  -.40.  For  C(f,v),  there  were  13  negative  values  with  a 
mean  of  -0.405  which  was  rounded  to  -0.40.  The  term  'trend 
correlations'  is  used  to  refer  to  the  following  values  for  the 
correlation  coefficients  between  stability  and  flow,  stability  and  air 
voids,  and  flow  and  air  voids,  respectively:  +0.30,  -0.40,  and  -0.40. 


26 


V  ■  J  ^H.p  v  »■  1"  ■  * 


▼ 


T 


V"  r-  r*  sr -  v  •  r 


T  a  c,  1  e  9 . 

Means  of  the  Marshall  Results  r  or  - 

.  ■  .  .  ll  ' 

Proj  ect 

Stability  Flew 

■;  :  <  - 

Adi rondack-A 

2240.1 

•  . 

Adirondack-3 

2341 .6 

1  0 .  C_ 

;  r.  a 

C  h  a  r  1  o  1 1  e  s  v  i  1 1  e -  A  f /■  J 

2702.6 

1  —  .  . ' 

2 .  o  6 

Cnarlottesville-SLW 

3614.7 

1  5.77 

j .  52 

Chautauqua 

2450.4 

9.59 

3.58 

Chemung-Chemung 

2427.3 

1 0 . 3 0 

3 .  46 

Chemung- F isherville 

2475.9 

9.05 

3.68 

DuBois 

2056.1 

10.44 

3.58 

Dutchess 

2353-6 

13-40 

4. 41 

Linden 

21 1 7.9 

1 1  . 90 

3.86 

Westchester — Col pro via 

2816.1 

11.41 

3.69 

Westchester-Peckham 

2686.2 

11.86 

3.64 

pooled 

2410 

11.87 

3-55 

Table  10. 

Standard  Deviations  of  the  Marshall  Results 
1978  Field  Data 

ror  the 

Proj  ect 

Stability  Flow 

Voids 

Adirondack- A 

288.51 

1  .  692 

0.722 

Adi  ror.dack-3 

256.46 

1  .  445 

0.623 

0  hvi  rlottesville-ANJ 

271.32 

1.349 

0.577 
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367.34 
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Table  11.  Correlation  Coefficients  of  the  Marshall 
for  the  1973  Field  Data 


Project 

Stability 

and 

Flow 

Stabi 1 i ty 
and 
Voids 

Flow 

and 

Voids 

Art i rondack-A 

0 . 3^2 

-0.773 

-0.741 

Adi rondack-3 

0.539 

-0.609 

-0 . 630 

Chari ottesville-ANJ 

-0.241 

-0.022 

-c .029 

C ha r 1 o  1 1  es  v i 1 1 e-S LW 

-0.548 

0.335 

-0 . 403 

na  u  t  au^ua 

0.324 

-0.507 

-0.354 

C  he  m  un  g-  C  he  rr.  un  g 

0.441 

0.01  4 

-0 . 481 

Chemung-F isherville 

0.453 

-U .339 

-0.381 

Du3ois 

0.330 

-0 .271 

-0 .51 1 

Dutchess 

0.0^7 

-0.421 

-0.143 

Linden 

-0.062 

-0.102 

0.044 

W'es  tones  ter-Col  pro  via 

0.243 

-0.498 

-0 .287 

Westchester-Peckham 

0.132 

-0.685 

-0.587 

Table  12. 

PWLs  of  the  Marshall  Results  for  the 
Proj  ects 

1978  Paving 

Number 

Marshall 

Project 

of  Tests 

PWL 

Adi rondack-A 

9 

62 . 4 

Adirondack-3 

29 

31.1 

Chari ottesville-ANJ 

54 

69 . 4 

Char 1 ot  t es  vi 1 1 e-S  LW 

53 

50.1 

Chautauqua 

27 

93-3 

C hen ung- Chemung 

24 

94.5 

Cne;nung-F  isherville 

56 

34.6 

Du3o  i  3 

32 

75 . 4 

Dutchess 

12 

33.7 

Linden 

52 

94 . 9 

W es  t  che  s  t  er-Col pr  0 v i a 

'• ) 

92.0 

West che 3  ter-Peckam 

80 

6  ri .  2 

28 


Taole  13.  Means  of  the  Marshall  Results  for  the  1981 
Field  Data 


Proj  ect 

Stability 

Flow 

Voids 

Atlantis  City 

2487  - 1 

10.02 

3.43 

Bal timore-Washington 

2794.0 

10.60 

3.40 

Rochester 

3207.3 

12.50 

3.69 

pooled 

2671 .8 

10.55 

3.47 

Table  14. 

Standard 
the  1981 

Deviation  of  the  Marshall  Results  for 
Field  Data 

Proj  ect 

Stability 

Flow 

Voids 

Atlantic 
Bal  tirnore 
Rochester 

City 

-Washington 

288.44 

1  68.53 

222.87 

0.801 

0.543 

1 .236 

0.737 

0.204 

0.447 

pool ed 

243.8 

0.84 

0.62 

29 


Table  21.  Summary  < 

of  Populat 

ion  PW'L  Val 

ues  for  the 

Projects 

Simulated 

Pro jec  t 

3 

Correlation  Coeff 

tab-flow  stab-voids 

ic Lents 

flow-voids 

PWL 

(corr . ) 

PWL 

( no  corr  . ) 

Adirondack-A 

0.34 

-0.77 

-0.74 

62.4 

80.8 

Adirondack-B 

0.59 

-0.61 

-0 . 63 

81.1 

88.7 

Char lottesville-AN J 

-0.24 

-0.02 

-0.03 

46.2 

46.3 

Char lottesv ill e-SLW 

1 

o 

0.34 

-0>1 

49.9 

52.4 

Chautauqua 

0.32 

-0.51 

-0.35 

96.6 

97.3 

Cheraung-C.hem 

0.44 

0.01 

-0.4b 

94.3 

96.9 

Chemung-Fish 

0.46 

-0 . 39 

-0.38 

84  „  6 

87.0 

Dubois 

0.33 

-0.27 

-0.81 

75.4 

86 . 2 

Dutchess 

0.05 

-0 . 43 

-0.14 

88.7 

90.0 

1.  Laden 

-0.06 

•  0.10 

0.04 

94.0 

94.1 

We  at Chester -Col p 

0.24 

-0.50 

-0.29 

93.0 

94.6 

West Chester -Peck 

0.13 

-0.69 

-0.59 

56.2 

68 . 6 

Atlantic  City 

0.07 

-0.33 

-0.30 

92.8 

94.2 

Baltimore-Wash . 

-0.60 

-0.30 

0.08 

99.0 

99.5 

Rochester 

0.09 

-0.24 

0.01 

99.3 

99.3 

Trend  * 

0 . 30 

-0.40 

-0.40 

97.0 

98.1 

*  On  this  project,  pooled  values  for  mean  and  standard  deviation  from 
the  1981  projects  were  used  along  wLth  the  trend  correlations.  The 
means  used  were  2672,  10,55  and  3.47  for  stability,  flow  and  air 
voids.  The  standard  deviations  were  243.8,  0.84  and  0.62. 


The  population  PWL  values  are  calculated  in  Box  2  using  the  triple 
numerical  integration  routine  and  the  'population’  statistics  input  in 
Box  1.  The  algorithm  used  to  effect  the  integration  is  adapted  from  an 
algorithm  (P9)  given  by  Davis  (9)  and  is  based  on  a  9-point  integration 
rule  (see  Chapter  3).  The  limits  of  integration  are  the  respective 
acceptance  limits.  These  limits  are  standardized  for  the  purposes  of 
implementation.  Thus,  if  XU  and  XL  are  the  upper  and  lower  limits  for 
variable  X,  then  the  respective  standardized  limits  are: 

U  =  (XU  -  XBARVSTD  and  L  =  (XL  -  XBAR) /  STD 

where  XBAR  and  STD  are  the  mean  and  standard  deviation,  respectively, 
input  in  Box  1 . 

The  PWL  value  for  the  population  is  then  used  with  the  payment 
schedule  in  Table  18  to  determine  the  correct  payment  for  the  lot.  The 
simulation  was  conducted  using  each  of  the  13  project  results  as  the 
'population'  statistics.  The  PWL  values  for  these  15  populations  appear 
in  Table  21.  To  examine  the  effect  of  the  correlation  between  variables 
on  the  PWL  values,  the  PWL  for  the  zero  correlation  case  is  also  shown 
for  each  project  in  Table  21. 

It  can  be  seen  in  Table  21  that  the  effect  of  correlation  is  to 
reduce  the  PWL  value  from  the  zero  correlation  case.  However,  the 
effect  is  quite  small  for  populations  with  high  PWL  values.  For 
example,  there  is  little  decrease  in  PWL  when  correlation  is  considered 
for  populations  which  would  receive  100  percent  payment,  i.e.,  for 
populations  with  PWL  values  greater  than  90.  The  large  differences  in 
PWL  values  occur  in  the  table  when  either  1  or  2  large  (greater  than 
.60)  negative  correlation  coefficients  are  present.  For  example,  on  the 
Adirondack-A  project,  where  there  are  2  large  negative  correlations 
(-0.77  and  -0.74)  there  is  an  18.4  point  decrease  in  PWL  when  the 
correlations  are  considered.  For  Char lottesilie-ANJ ,  on  the  other  hand, 
which  has  very  low  correlaton  coefficients,  the  PWL  value  only  drops 
from  46.3  to  46.2  when  the  correlations  are  included. 

After  the  population  PWL  value  i?  determined  by  numerical 
integration,  the  simulation  program  then  generates  4  sets  of  Marshall 
test  results  for  the  first  project  day.  These  4  sets  of  test  values  are 
generated  from  a  trivariate  normal  distribution  with  the  parameters, 
i.e.,  means,  standard  deviations  and  correlation  coefficients,  input  in 
Box  1.  The  payment  factor  for  the  first  day  (or  lot)  is  then  calculated 
by  each  of  the  methods.  This  process  is  then  repeated  for  a  total  of 
100  paving  days  for  each  project  simulated. 


Numerical  Integration 

The  first  method  considered  for  establishing  the  payment  factor  for 
each  lot  was  triple  numerical  integration  (Box  4).  This  method 
considers  the  correlations  between  each  of  the  variables  along  with  the 
means  and  standard  deviations.  The  PWL  is  computed  in  Box  4  and 
corresponds  to  the  percentage  of  the  total  volume  of  the  trivariate 
normal  distribution  that  falls  within  the  acceptance  limits.  This  is 


CHAPTER  VI 


COMPUTER  SIMULATION  ANALYSIS 


In  Chapter  V,  several  methods  for  determining  the  payment  factor 
for  the  Marshall  properties  are  presented.  The  current  chapter  presents 
the  procedure  and  results  from  a  computer  simulation  analysis  to 
investigate  the  performance  of  the  methods.  Computer  simulation  is  used 
to  represent  the  Marshall  test  results  for  100  lots  of  material  for  each 
project  considered.  Input  to  the  simulation  program  is  based  on  the 
data  collected  on  the  15  runway  paving  projects  discussed  previously. 

Four  methods  are  considered  for  determining  the  payment  factor  for 
the  Marshall  properties.  The  methods  examined  include:  1)  triple 
numerical  integration,  2)  multiplying  the  3  individual  property  PWL 
values  or  payment  factors,  3)  averaging  the  3  individual  PWL  values  or 
payment  factors  and,  4)  using  the  smallest  of  the  3  individual  PWL 
values  or  payment  factors. 


Simulation  Procedures 


Computer  simulation  was  used  to  investigate  the  performance  of  the 
various  methods  (discussed  in  Chapter  V)  for  determining  the  payment 
factor  for  multiple  acceptance  properties.  Computer  simulation  was  used 
to  develop  Marshall  test  results  for  100  paving  lots  using  the  results 
from  the  15  paving  projects  on  which  data  were  collected.  The  means, 
standard  deviations  and  correlation  coefficients  from  each  of  the  15 
projects  were  used  as  the  'population'  statistics  in  the  various 
simulation  analyses. 

The  results  of  4  Marshall  tests  were  generated  for  each  paving  day 
in  the  simulation  analysis.  The  test  values  for  the  3  correlated 
Marshall  properties,  i.e.,  stability,  flow  and  air  voids,  were  generated 
simultaneously  by  an  algorithm,  CSDA,  based  on  Cholesky's  Sequential 
Matrix  Decomposition  (see  Chapter  III).  The  simulated  Marshall  results 
were  then  used  to  determine  the  payment  factor  for  the  lot  using  each  of 
the  methods  described  previously.  The  procedures  for  determining  these 
payment  factors  in  the  sim>'1aton  analyses  are  presented  in  the  next 
section . 

The  simulation  procedure  is  presented  in  the  flow  diagram  of  Figure 
II.  A  detailed  user's  guide  for  the  program  is  presented  in  Appendix  C 
and  a  copmplete  listing  of  the  program  appears  in  Appendix  D.  The 
'population'  statistics  referred  to  in  Box  1  of  Figure  11  are  those  from 
the  15  runway  paving  projects  from  1978  and  1981.  The  statistics  input 
for  each  project  simulation  are  the  mean  and  standard  deviation  values 
for  each  of  the  3  Marshall  properties  and  the  3  correlaton  coefficients. 
The  values  used  in  the  simulations  are  presented  in  Tables  9-11  and 
13-15. 


in 


b)  Average  pay  factor  -  Mississippi  Specifications  -  401.22  B. 


"The  final  percentage  for  each  lot,  any  of  which  characteristics 
for  asphalt  content,  gradation,  density,  and  stability  were  not 
within  reasonably  close  conformity,  shall  be  determined  as  in  the 
following  example. 

"Assume  price  adjustment  for  asphalt  content  is  90  percent,  for  the 
No.  200  sieve  is  70  percent,  for  density  is  100  percent  and  for 
stability  is  100  percent. 

"Thus  the  final  pay  factor  for  that  lot  would  be: 

90S  +  70%  +  100%  +  100% 

4 

cN  Pr  >duct  of  all  pav  factors  -  Nebraska  Specifications  -  507.13. 

"...  that  lots  of  asphalt  concrete,  accepted  by  the  Engineer, 
shall  be  paid  for  at  the  contract  unit  price  per  ton  for  the  item, 

.  .  .  multiplied  by  product  of  the  lot  pay  factors  for  asphalt 
content,  retention  on  the  applicable  control  sieves,  and  density  of 
the  compacted  asphaltic  concrete." 

The  numerical  integration  approaches  presented  previously  include 
the  correlation  among  the  properties  used  when  calculating  the  PVL 
values  used  to  establish  payment.  The  individual  properties  approaches 
do  not  directly  consider  the  correlation  which  may  exist  among  the  3 
properties  being  considered.  The  payment  factors  product  method 
essentially  assumes  that  there  is  zero  correlation  among  the  properties. 
The  payment  factors  averaging  method  assumes  no  functional  correlation 
among  the  3  properties,  or  that  any  correlation  is  somehow  accounted  for 
in  the  averaging  process.  The  minimum  payment  factor  approach 
implicitly  assumes  perfect  correlation  among  the  3  variables. 


standardized  variates  because  the  volume  beyond  these  limits  is 
negligible.  Bivariate  normal  tables  were  developed  that  give  the  volume 
under  the  bivariate  normal  surface  from  -3.0  for  both  variates  to  a 
particular  value  of  each  standardized  variate. 

As  shown  in  Figure  10,  the  area  between  the  4  specification  limits 
which  corresponds  to  the  volume  under  the  bivariate  normal  distribution 
(?VL)  can  be  expressed  in  terms  of  4  component  volumes.  The  PWL  (shaded 
region  in  Figure  10)  can  be  expressed  as  the  total  area  (o,  ul,  y,  u2) 
minus  the  2  side  rectangles  (o,  dl,  z,  u2)  ^nd  (o,  d2,  x,  ul)  plus  the 
corner  rectangle  (o,  d2,  h,  dl)  which  was  subtracted  twice.  Hence,  the 
PWL  can  be  expessed  as: 

PWL  =  V(ul ,u2)  -  V(ul,d2)  -  V(dl,u2)  +  V(dl,d2) 
where  ul  =  upper  limit  for  first  variate, 

u2  =  upper  limit  for  second  variate, 
dl  =  lower  limit  for  first  variate, 
d2  =  lower  limit  for  second  variate. 

The  bivariate  normal  tables  are  given  in  Appendix  B.  Because  the 
bivariate  normal  distribution  variates  are  standardized,  the  tables  are 
symmetrical,  that  is,  V(ul,d2)  is  equal  to  V(d2,ul). 

Individual  Properties  Approaches 

The  bivariate  approach  still  presents  implementation  problems  at 
the  present  time.  It  is  so  different  from  current  methods  that 
resistance  from  field  personnel  is  inevitable.  In  light  of  this,  a 
number  of  approaches  were  also  considered  that  are  based  on  the  same  PWL 
estimation  procedures  currently  employed  by  the  FAA  Eastern  Region. 

These  procedures  consist  of  determining  either  a  PWL  or  payment  factor 
(PAY)  for  each  of  the  properties  individually,  and  then  combining  these 
in  some  fashion  to  arrive  at  a  total  PWL  or  PAY  value  for  the  lot.  The 
approaches  considered  include:  1)  multiplying  the  individual  PWL  or  PAY 
values,  2)  averaging  the  individual  PWL  or  FAY  values  and,  3)  using 
the  smallest  individual  PWL  or  PAY  value. 

These  approaches  are  similar  to  those  currently  employed  by  some 
state  highway  agencies  that  apply  price  adjustments  for  more  than  one 
characteristic.  Examples  of  these  methods,  from  Moore  et.  al.  (10),  are 
quoted  below: 

a)  Lowest  Pay  factor  -  Georgia  Specifications  -  40O.06  A. 

"When  two  or  more  pay  factors  for  a  specific  acceptance  lot  are 

less  than  1.0,  the  adjusted  payment  will  be  determined  by 

multiplying  the  contract  unit  price  by  the  lowest  pay  factor." 


Table  19.  Meaa  Project  Stability  PWL  Values  ror  the  1972 
Paving  Projects 


Proj  ect 


Marshall 

Stability  PWL 


Adi rondack-A 

Adi rondaek-3 

Chari ot  t  esv i 1 1 e- AMJ 

Charlottesville-SLW 

Chautauqua 

Chemung-Chemung 

Chemung-F ishervil le 

DuBois 

Dutchess 

Linden 

Westchester-Colprovia 

Westchester-Peckham 


22- 40 . 1 

23- 41  .6 
2702.6 
3614.7 
24^0 . 4 
242"’ .  3 

2475.9 

2056.1 
2355. 6 

2117.9 

231 6.1 

2686.2 


93. 

98. 

100. 

100.0 

100.0 

100.0 

99.5 

93.1 

100.0 

99.4 

100.0 

97.9 


Table  20.  Mean  Project  Stability  PWL  Values  for  the  1981 
Paving  Projects 


Proj  ect 


Marshall 

Stability  PWL 


o  io  cr» 


160,000  tables  would  be  needed  to  cover  all  the  possible  values  of  the 
variates  and  their  correlations.  The  number  of  tables  can  be  reduced 
significantly  if  the  correlation  values  are  limited  to  a  few 
combinations,  possibly  around  the  trend  values.  However,  such 
simplification  limits  the  generality  of  this  approach.  Therefore, 
trivariate  normal  tables  are  not  a  practical  alternative. 

Bivariate  Approach 

The  first  step  considered  in  an  effort  to  simplify  the  procedures 
of  the  trivariate  approach  takes  advantage  of  the  fact  that,  for  nearly 
all  data  collected  on  all  projects,  Marshall  stability  rarely  failed  to 
meet  the  acceptance  requirements.  Taking  this  into  consideration,  the 
problem  can  be  reduced  to  a  bivariae  normal  distribution  by  considering 
stability  on  an  accept-or-re ject  basis,  and  using  only  flow  and  air 
voids  for  payment  determination.  This  reduces  to  19  the  number  of 
tables  necessary  to  reasonably  estimate  PWL,  and  makes  manual 
computations  feasible. 

By  reducing  the  number  of  acceptance  variables  from  3  to  2,  the 
number  of  statistics  is  reduced  from  9  (3  means,  3  standard  deviations 
and  3  correlations)  to  5  (2  means,  2  standard  deviations  and  1 
correlation) . 

The  field  data  from  both  the  1978  and  1981  projects  show  that 
compliance  with  stability  is  more  attainable  than  compliance  with  flow 
and  air  voids.  All  projects  for  both  years  have  a  mean  project 
stability  FWL  well  above  90  (Tables  19  and  20).  Therefore,  stability 
for  most  projects  shold  be  accepted  at  full  payment.  Any  major 
deficiency  in  the  material's  trivariate  PWL  is  probably  due  to 
deficiencies  in  flow  or  air  voids.  Because  flow  and  air  voids  are 
correlated,  the  bivariate  normal  distribution  should  be  used  to 
calculate  PWL.  Table  18  can  then  be  used  to  obtain  the  adjusted  payment 
factor . 

The  bivariate  approach  is  much  simpler  and  more  practical  to 
implement  than  the  trivariate  method,  and  does  not  have  the  same 
limitations. 


As  shown  below,  the  determinant  of  the  bivariate  correlation 
matrix,  |c|,  is  always  positive  definite  since  -1  <  P  <  1 . 


C 


1  P 
P  1 


=  1  -  P*P 


Also,  because  acceptance  will  be  based  on  only  2  variables,  the 
number  of  statistics  needed  to  generate  tables  is  reduced  to  3  (2 
standardized  variates  and  1  correlation).  Consequently,  the  number  of 
tables  for  31  standardized  variate  values  (from  -3.0  to  +3.0  with  0.1 
increments)  and  19  correlation  values  (from  -0.9  to  +0.9  with  0.1 
increments)  is  19.  These  can  be  contained  in  a  small  handbook.  The  2 
numbers,  -3.0  and  +3.0,  are  used  as  lower  and  upper  limits  for  the 


method  for  claculating  |C[  is  illustrated  in  the  steps  below. 


1 

C12 

C13 

[C]  =  C21 

1 

C23 

C31 

C32 

1 

J 

]C|  =  1  (1  -  C23  *  C23)  -  Cl 2  (C12  -  C13  *  C23) 

+  C13  (C12  *  C23  -  C13) 

| C ]  =  1  +  2  (Cl 2  *  C13  *  C23)  -  (C12  *  C12) 

-  (C13  *  C13)  -  (C23  *  C23) 

where  C12  =  correlation  between  stability  and  flow, 

C13  =  correlation  between  stability  and  air  voids, 

C23  =  correlation  between  flow  and  air  voids. 

When  all  3  correlations  are  large  in  magnitude  and  negative,  |C| 
will  be  negative.  For  example,  if  C12  =  C13  =  C23  =  -0.6,  then  the 
determinant,  |cj,  will  be  equal  to  -0.296.  It  is  not  likely  that  this 
situaton  will  often  occur  in  practice. 

2.  Performing  numerical  integration  requires  access  to  a  large 
digital  computer.  Nearly  71,000  statements  are  executed  to  calculate  a 
single  trivariate  PWL.  This  problem  can  be  overcome  by  installing  a 
dial-up  computer  terminal  at  the  project  site  to  provide  access  to  a 
central  computer  that  can  make  the  necessary  computations. 

Alternatively,  it  may  be  possible  to  adapt  the  integration  routine  to 
operate  on  a  micro-computer  that  can  he  located  at  the  project  office. 

3.  The  computations  needed  to  obtain  sample  statistics  (3  means,  3 
standard  deviations  and  3  correlation  coefficients)  from  4  Marshall 
tests  is  a  fairly  complicated  procedure.  However,  computations  can  be 
performed  easily  by  a  programmable  hand-held  calculator  or  a 
micro-computer . 

As  indicated  above,  to  implement  triple  integration  the  project 
sites  should  have,  or  have  access  to,  computer  facilities.  Since  this 
situation  does  not  always  exist,  at  least  at  the  present  time, 
alternatives  must  be  considered.  One  such  alternative  is  the  use  of 
trivariate  normal  tables.  There  are  8  variables  (1  upper  and  1  lower 
standardized  variate  for  air  voids  and  flow,  1  lower  standardized 
variate  for  stability,  and  3  correlation  coefficients)  that  must  be 
included  in  the  tables.  Assuming  that  each  variable's  range  of  values 
can  be  broken  down  into  20  intervals,  64  million  (number  of  intervals, 
20,  raised  to  the  6th  power,  i.e.,  the  number  of  variables  less  2) 
tables  will  be  needed  to  include  all  the  possible  values  of  these  8 
variables.  The  number  of  variables  can  be  reduced  to  6  (3  standardized 
variates  and  3  correlations)  if  a  procedure  which  expresses  the  PWI.  as  a 
function  of  8  PWLs  having  variates  without  lower  limits  is  used.  Still, 


Table  18.  Current  FAA  Eastern  Region  Mat  Density  Payment  Schedule 


Calculated  PWL  Value 


Payment  Factor  (percentage) 


90  -  100 
80  -  90 
65  -  80 
Below  65 


100 

0.5  PWL  +  55 
2.0  PWL  -  65 

50  (or  remove  and  replace) 


CHAPTER  V 


ACCEPTANCE  AND  PAYMENT  PROCEDURES 


With  the  preliminary  analyses  complete,  the  major  area  of  the 
research  effort  was  a  computer  simulation  analysis  to  investigate  the 
potential  performance  of  multiple  price  adjustment  approaches.  Due  to 
the  complexity  of  the  problem  presented  by  the  case  of  3  acceptance 
criteria,  it  is  necessary  to  use  computer  simulation  to  develop  the 
operating  characteristics  for  the  proposed  acceptance  plans.  The 
simulation  effort  consisted  of  sampling  from  a  trivariate  normal 
distribution  and  then  calculating  the  payment  level  using  several 
different  payment  determination  procedures.  Each  of  the  methods 
considered  used  the  current  FAA  density  payment  schedule  shown  in  Table 
18  to  convert  the  estimated  PWL  values  to  payment  factors. 

A  number  of  different  approaches  were  considered  for  determining 
the  acceptable  payment  for  a  lot  of  material  based  upon  the  3  Marshall 
properties.  These  approaches  can  be  divided  into  2  major  categories. 

The  first  category  relates  to  approaches  which  consider  the  multivariate 
nature  of  the  problem.  The  second  category  relates  to  methods  which 
consider  the  3  properties  individually,  and  then  incorporate  the  3 
values  into  a  single  (composite)  payment  level. 

Multivariate  Approaches 


Trivariate  Approach 

The  most  theoretically  acceptable  approach  to  use  as  a  means  of 
evaluating  Marshall  results  for  acceptance  is  based  on  synthesizing  the 
3  values,  stability,  flow  and  air  voids,  into  a  single  number  for 
acceptance  purposes.  This  number  is  the  percentage  of  the  total  volume 
of  the  tri  variate  normal  distribution  that  falls  within  the  acceptance 
limits  (trivariate  PWL).  This  is  a  logical  extension  of  the  single 
variable  acceptance  approach  based  on  PWL  currently  employed  by  the  FAA 
Eastern  Region. 

This  approach  uses  9  sample  statistics  calculated  from  the  test 
results  for  each  lot  to  estimate  the  PWL  value  for  the  lot.  These 
values  include  the  sample  means  and  variances  for  stability,  flow  and 
air  voids,  and  the  3  correlation  coefficients. 

There  are  several  limitations  and  disadvantages  to  the  use  of 
triple  numerical  integration  for  acceptance  calcu1  nns.  These 
limitations  include: 

1.  The  correlation  matrix  must  be  positive  definite.  In  a  few 
situations,  the  correlation  matrix  might  not  be  positive  definite,  i.e., 
the  determinant  of  the  correlation  matrix,  |C|,  might  be  negative.  The 


Table  17.  Laboratory  Correlation  Coe‘,‘' lcients  Among  the  Marshall 
Properties  (3) 


Gradation 

Asphal t 
Content 

Stabi 1 i ty 
and 

Flow 

Stabil ity 
and 

Voids 

Flow 

and 

Voids 

A 

5.0 

0 .449 

-0.286 

0.363 

5.5 

0.522 

-0.329 

-0 .01 0 

6.0 

0 . 360 

-0.415 

-0.495 

6.5 

0.6114 

0.378 

-0.137 

7.0 

0.770 

0.133 

-0.256 

7.5 

-0.263 

-0.619 

-0.023 

3  5.0 

0.645 

-0.532 

-0.220 

5.5 

0.422 

0.444 

0.084 

6.0 

0.116 

-0.200 

-0 . 682 

6.5 

0.674 

-0.010 

-0 . 1  34 

7.0 

0.692 

-0.401 

-0.1  43 

7.5 

0.350 

-0.532 

-0.252 

I 


C  5.0 

0.298 

-0.416 

-0 . 529 

5.5 

-0.223 

-0.396 

-0.30c 

6.0 

0.278 

-0.473 

-0.753 

6 . 5 

-0.005 

-0.113 

-0.767 

7.0 

-0.547 

-0.407 

0.01  7 

7.5 

0.540 

-0 .631 

-0.345 

D  5.0 

0.006 

-0.156 

-0.14  7 

5.5 

C  .048 

-0.601 

0.537 

6.0 

0.282 

-0.643 

-0 .493 

6.5 

0.032 

-0.635. 

-0.731 

7.0 

-0.260 

-0.515 

0 . 306 

7.5 

0.383 

-0.457 

~0 . 636 

Table  15.  Correlation  Coefficients  of  the  Marshall  Results 
for  the  1981  Field  Data 


Project 

Stabil i ty 
and 

Flow 

Stabil i ty 
and 
Voids 

Flow 

and 

Voids 

Atlantic  City 

0.069 

-0.33^ 

-0.301 

Bal timor e-Washi ngton 

-0.601 

-0.296 

0.075 

Rochester 

0.086 

-0.235 

-0.012 

Table  16.  PWLs  of  the  Marshall 
Projects 

Results  for  the 

1981  Paving 

Number 

Marshall 

Project 

of  tests 

PWL 

Atlantic  City 

198 

92.8 

Bal timore-Washi ngton 

67 

99.0 

Rochester 

53 

99.3 

accomplished  by  the  same  algorithm  that  was  used  in  Box  2  to  determine 
the  population  PWL  value. 

The  limits  of  integration  are  the  standardized  acceptance  limits. 
The  sample  statistics,  XBAR  and  STD,  used  to  calculate  the  standardized 
acceptance  limits  will  vary  for  each  project  day.  Therefore,  the  limits 
of  integration  will  also  vary.  To  reduce  integration  time,  the  largest 
upper  and  smallest  lower  integration  limits  for  all  variables  are  set  at 
3.5  and  -3.5,  respectively.  Once  the  PWL  value  is  calculated  by  the 
integration  subroutine,  the  payment  factor  is  determined  from  the 
schedule  in  Table  18. 

Individual  Properties 

As  indicated  previously,  several  methods  may  be  used  to  compute  a 
composite  payment  factor  based  on  the  3  individual  Marshall  properties. 
Each  of  these  methods  is  based  on  determining  either  PWL  values  or 
payment  factors  for  each  of  the  properties  individually,  then  combining 
the  3  individual  values  into  a  single  composite  payment  factor.  The 
methods  considered  in  the  computer  simulation  analyses  for  determining 
the  composite  payment  factor  can  be  divided  into  2  categories.  The 
first  category  consists  of  those  methods  that  combine  the  individual  PWL 
values  into  a  single  PWL  value  that  is  then  used  to  determine  the 
payment  factor  from  Table  18.  The  second  category  consists  of  those 
methods  that  detemine  a  payment  factor  for  each  individual  property  and 
then  combine  the  payment  factors  into  a  single  composite  payment  factor. 

Three  methods  for  obtaining  a  composite  value  were  used  with  each 
category  described  in  the  previous  paragraph.  These  methods  include: 

1)  multiplying  the  individual  PWL  values  or  payment  factors,  2) 
averaging  the  individual  PWL  v;  "'ues  or  payment  factors  and  3)  using  the 
smallest  of  the  individual  PWL  values  or  payment  factors.  These 
procedures  are  shown  in  the  flow  chart  in  Figure  11. 

Once  the  4  sets  of  Marshall  test  results  are  generated  in  Box  3, 
the  sample  means  and  standard  deviations  are  used  to  determine  the  3 
individual  property  PWL  values  bv  the  quality  index  approach  currently 
used  by  the  FAA  Eastern  Region  (Box  5).  In  Box  6,  the  composite  PWL 
value  is  obtained  by  each  of  the  3  methods  presented  above.  The  payment 
factor  is  then  determined  from  Table  18  using  the  composite  PWL  value. 

In  Box  7,  individual  payment  factors  are  first  determined  from  Table  IS 
for  each  of  the  3  properties.  The  individual  payment  factors  are  then 
combined  into  composite  payment  factors  by  each  of  the  3  methods 
described  above. 

The  procedures  outlined  in  Boxes  3-7  are  repeated  a  total  of  100 
times  for  each  set  of  'population'  statistics,  i.e.,  projects, 
considered.  The  results  for  the  100  project  days  are  then  summarized  in 
Box  8.  The  results  from  Box  8  can  be  used  to  evaluate  the  performance 
of  each  of  the  payment  determination  methods  investigated. 


:  .1 


Evaluation  Criterion 


Two  important  factors  to  be  considered  when  evaluating  an  estimator 
are  the  bias  and  variability  of  the  estimator.  The  variability  01  the 
estimator  is  represented  by  the  variance.  By  way  of  definition,  an 
estimator  is  unbiased  if  its  expected  value  is  the  same  as  the  parameter 
(in  this  cae,  the  payment  factor)  it  is  being  used  to  estimate.  In  the 
simulation  analyses,  the  mean  square  error  (MSE)  of  a  payment 
determination  method  is  used  as  the  norm  and  the  minimum  MSE  as  the 
criterion  for  choice  between  the  methods.  The  MSE  norm  is  chosen 
because  it  incorporates  the  2  important  measures  of  bias  and  variance. 
The  MSE  for  a  method  can  be  described  as  follows: 


if 

Bias  =  E[ PHAT(i) ]  -  PAY 

and 

Var [PHAT(i) ]  =  E[PHAT(i)  -  E(PHAT)]: 


then 

MSE  =  E[PHAT(i)  -  PAY]2  =  Var[ (PHAT(i) ]  +  (Bias)2 


where: 


PAY 

i 

PHAT(i) 

E[ PHAT(i) ] 
E(PHAT) 

Var 


=  correct  payment  factor  for  the  poputlation 
=  payment  determination  method,  i  =  1,2,.... 7 
=  estimated  payment  factor  using  method  i 
=  expected  payment  factor  for  method  i 
=  expected  value  of  the  payment  factor 
=  variance  of  the  term  in  the  brackets. 


For  computational  purposes,  the  sampling  equivalents  of  the 
expectations,  with  the  averages  being  taken  over  the  100  replications, 
are  used. 


A  total  of  7  payment  determination  methods  are  evaluated  with  the 
MSE  criterion  in  the  simulation  analyses.  These  7  methods  include: 

1)  triple  numerical  integration  using  the  daily  sample  means, 
standard  deviations  and  correlation  coefficients, 

2)  multiplying  the  individual  PWL  values  to  obtain  a  composite  PWL 
value , 

3)  averaging  the  individual  PWL  values  to  obtain  a  composite  PWL 
value , 

4)  using  the  smallest  individual  PWL  value  as  the  composite  PWL 
value, 

5)  multiplying  the  individual  payment  factors  to  obtain  a  composite 
payment  factor, 


6)  averaging  the  individual  payment  factors  to  obtain  a  composite 

payment  factor  and 

7)  using  the  smallest  individual  payment  factor  as  the  composite 

payment  factor. 

SIMULATION  RESULTS 

The  results  for  each  project  simulated  are  the  payment  statistics 
(the  mean  and  variance  of  the  100  payment  factors),  the  Bias  and  the 
MSB.  The  results  for  the  simulation  exercise  are  given  in  Tables  22  and 
23.  Table  22  presents  the  results  of  the  1973  simulated  projects. 

Table  23  presents  the  results  for  the  198!  projects  along  with  the 
results  using  the  pooled  means  and  standard  deviations  from  the  3 
projects  and  the  trend  correlations.  For  each  project  in  the  tables, 
t fie  mean  and  variance  of  the  100  payment  factors  and  the  Bias  and  MSE 
values  are  shown  for  each  of  the  7  payment  determination  methods. 

Analysis  of  the  Results 

The  results  in  Tables  22  and  23  indicate  that  the  performance  of 
the  payment  determination  methods  is  influenced  by  the  quality  of  the 
material  being  evaluated.  For  projects  with  low  quality,  and  therefore 
low  population  payment  factors  (e.g.,  A dirondack-A,  Charlottesville-ANJ 
and  -SLW,  and  Westchester-Peck  with  true  payment  factors  of  50),  the 
triple  integration  approach  provided  less  Bias  and  smaller  MSE  values. 
For  projects  with  high  quality  and  high  population  payment  factors 
(e.g.,  the  8  projects  with  true  payment  factors  of  100),  the  averaging 
methods,  methods  3  and  6,  provide  the  superior  results.  As  noted 
previously,  the  effect  of  correlator)  among  the  variables  is  relatively 
smal1  for  populations  with  high  PWL  values.  This  may  explain  why  the 
averaging  methods  work  well  on  the  projects  which  have  high  PWL  values 
(as  evidenced  by  the  pay  factors  or  ICO) . 

The  low  expected  payment  factors,  the  resulting  large  negative 
biases  and  the  high  MSE  values  for  the  integration  method  (Method  1)  can 
be  associated  with  2  factors.  The  first  is  the  fact  that  the  small 
number  of  samples  per  day  (i.e.,  4)  does  not  provide  a  very  good 
est irate  for  the  population  ccrrelaton  vnlues.  That  is,  the  correlation 
coefficients  calculated  for  sample  sizes  of  4  may  vary  greatly  from  the 
values  of  the  populaion  from  which  they  were  drawn.  Since  these 
coefficients  are  used  in  the  triple  integration  routine,  the  PWL  values 
resulting  from  the  integration  will  also  tend  to  be  highly  variable. 

This  fact  is  reflected  in  the-  high  variance  and  MSE  vaLues  for  Method  1 
in  Tables  22  and  23. 

The  second  factor  affecting  the  performance  of  the  integration 
method  relates  to  the  payment  schedule  that  is  used.  The  payment 
schedule-  (Table  18)  was  developed  for  the  single  variable  case  of  mat 
density.  As  currently  implemented  by  the  FAA  Eastern  Region,  on  an 
acceptance  but  not  price  determination  basis,  the  Marshall  properties 
are  considered  to  he  in  substantial  compliance  with  the  specifications 
if  the  individual  PWL  values  fur  each  of  the  3  properties  are  90  or 


Table  22.  Results  of  Computer  Simulation  Analyses 


Project  Method* 

E[ PHAT]# 

Var [PHAT]0 

Bias 

MSE 

Adirondack-A  1 

57.5 

253.9 

7.5 

310.2 

2 

85.9 

381.5 

35.9 

1670.7 

(50.0)$  3 

98.9 

10.3 

48.9 

2403.8 

4 

91.2 

176.7 

41.2 

1875.9 

5 

90.5 

216.2 

40.5 

1854.8 

6 

96.7 

28.2 

46.7 

2208.8 

7 

91.2 

176.7 

41.2 

1875.9 

Adirondack-B  1 

66.5 

423.6 

-29.1 

1268.1 

2 

93.6 

154.3 

-  1.9 

157.8 

(95.5)  3 

99.8 

0.9 

4.3 

19.0 

4 

95.4 

104.9 

-  0.1 

104.9 

5 

95.2 

114.1 

-  0.4 

114.2 

6 

98.4 

13.3 

2.8 

21.4 

7 

95.4 

104.9 

-  0.1 

104.9 

Charlottesville-ANJ  1 

51.5 

51.2 

1.5 

53.5 

2 

54.7 

157.8 

4.7 

179.6 

(50.0)  3 

87.5 

193.7 

37.5 

1599.6 

4 

56.3 

205.3 

6.3 

245.4 

5 

51.1 

323.7 

1.1 

324.9 

6 

82.0 

64.6 

32.0 

1089.7 

7 

56.3 

205.3 

6.3 

245.4 

Charlottesville-SLW  1 

52.2 

57.2 

2.2 

62.1 

2 

58.6 

271.5 

8.6 

345.5 

(50.0)  3 

92.0 

113.3 

42.0 

1876.4 

4 

63.2 

342.1 

13.2 

516.7 

5 

59.4 

435.2 

9.4 

524.1 

6 

85.5 

69.8 

35.5 

1326.7 

7 

63.2 

342.1 

13.2 

516.7 

#  -  expected  payment  factor  @  -  variance  of  payment  factor 


$  -  correct  payment  factor  for  the  population 
*  -  payment  determination  method: 

1.  triple  numerical  integration 

2.  multiplying  the  individual  PWL  values 

3.  averaging  the  individual  PWL  values 

A.  using  the  smallest  individual  PWL  value 

5.  multiplying  the  individual  payment  factors 

6.  averaging  the  individual  payment  factors 

7.  using  the  smallest  individual  payment  factor 


Table  22.  Results  of  Computer  Simulation  Analyses  (continued) 


Project 

Method* 

E( PHAT]# 

Var[PHAT]@ 

Bias 

MSE 

Chautauqua 

1 

85.3 

366.0 

-14.7 

582.7 

2 

99.0 

28.5 

-  1.0 

29.5 

(100)$ 

3 

100.0 

0.0 

0.0 

0.0 

4 

99.0 

28.5 

-  1.0 

29.5 

5 

99.0 

28.5 

-  1.0 

29.5 

6 

99.7 

3.2 

-  0.3 

3.3 

7 

99.0 

28.5 

-  1.0 

29.5 

Chemung-Chem 

1 

79.9 

428.3 

-20.1 

833.0 

2 

98.9 

30.1 

-  1.1 

31.3 

(100) 

3 

100.0 

0.0 

0.0 

0.0 

4 

98.9 

30.1 

-  1.1 

31.3 

5 

'98.9 

30.1 

-  1.1 

31.3 

6 

99.6 

3.4 

-  0.4 

3.5 

7 

98.9 

30.1 

-  1.1 

31.3 

Chemung-Fish 

1 

69.9 

437.0 

-27.4 

1189.4 

2 

91.3 

207.4 

-  6.0 

243.8 

(97.3) 

3 

99.8 

0.5 

2.5 

6.7 

4 

9x.7 

203.4 

-  5.7 

235.4 

5 

91.6 

204.1 

-  5.7 

236.3 

6 

97.2 

22.8 

-  0.1 

22.8 

7 

91.7 

203.4 

-  5.7 

235.4 

Dubois 

1 

60.2 

311.1 

-25.6 

966.7 

2 

91.1 

241.8 

5.3 

270.4 

(85.8) 

3 

99.4 

4.7 

13.7 

191.4 

4 

95.2 

107.0 

9.4 

195.3 

5 

94.7 

128.3 

9.0 

208.5 

6 

98.2 

16.0 

12.4 

169.8 

7 

95.2 

107.0 

9.4 

195.3 

#  -  expected  payment  factor  @  -  variance  of  payment  factor 


$  -  correct  payment  factor  for  the  population 


payment  determination  method: 

1.  triple  numerical  integration 

2.  multiplying  the  individual  PWL  values 

3.  averaging  the  individual  PWL  values 

4.  using  the  smallest  individual  PWL  value 

5.  multiplying  the  individual  payment  factors 

6.  averaging  the  individual  payment  factors 

7.  using  the  smallest  individual  payment  factor 


Table  22.  Results  of  Computer  Simulation  Analyses  (continued) 


Project 

Method* 

E[PHAT]# 

Var [PHAT]@ 

Bias 

MSE 

Dutchess 

1 

75.6 

387.3 

-23.8 

953.1 

2 

95.8 

87.9 

-  3.5 

100.2 

(99.3)$ 

3 

99.9 

0.3 

0.6 

0.6 

4 

96.9 

39.5 

-  2.5 

45.6 

5 

96.7 

46.6 

-  2.6 

53.5 

6 

98.9 

5.6 

-  0.5 

5.8 

7 

96.9 

39.5 

-  2.5 

45.6 

Linden 

1 

77.8 

411.0 

-22.2 

903.5 

2 

98.1 

44.3 

-  1.9 

48.1 

(100) 

3 

100.0 

0.1 

0.0 

0.1 

4 

98.3 

27.7 

-  1.7 

30.5 

5 

98.3 

28.8 

-  1.7 

31.7 

6 

99.4 

3.3 

-  0.6 

3.6 

7 

98.3 

27.7 

-  1.7 

30.5 

Westchester-Colp 

1 

75.1 

428.7 

-24.9 

1046.5 

2 

97.6 

70.0 

-  2.4 

75.6 

(100) 

3 

100.0 

0.1 

0.0 

0.1 

4 

97.9 

62.6 

-  2.1 

67.1 

5 

97.9 

62.6 

-  2.1 

67.1 

6 

99.3 

7.0 

-  0.7 

7.5 

7 

97.9 

62.6 

-  2.1 

67.1 

Westchester-Peck 

1 

54.7 

158.5 

4.7 

180.9 

2 

73.5 

500.9 

23.5 

1054.1 

(50.0) 

3 

95.6 

77.4 

45.6 

2153.0 

4 

79.2 

398.5 

29.2 

1252.0 

5 

75.6 

590.8 

25.6 

1246.6 

6 

90.9 

95.2 

40.9 

1771.0 

7 

79.2 

398.5 

29.2 

1252.0 

#  -  expected  payment 

factor 

@  - 

variance  of  payment  factor 

$  -  correct  payment  factor  for  the  population 
*  -  payment  determination  method: 

1.  triple  numerical  integration 

2.  multiplying  the  individual  PWL  values 

3.  averaging  the  individual  PWL  values 

4.  using  the  smallest  individual  PWL  value 

5.  multiplying  the  individual  payment  factors 

6.  averaging  the  individual  payment  factors 

7.  using  the  smallest  individual  payment  factor 


Table  23. 

Result  a  of  Computer 

Si  mu  Inti  on 

Analyses  -  1981  f'rojer  t 

s 

Pro joe l 

Met  hod* 

K[  I'll  ATI# 

Varf  PIIAT](<* 

Bins 

MSP. 

At lant  i  c 

City  l 

73.8 

397.1 

-24.2 

981  .3 

2 

90.9 

60.2 

-  3.1 

69 . 7 

(100)$ 

3 

99.9 

0.1 

-  0.1 

0.  1 

4 

97.8 

23.8 

-  2.2 

30.0 

3 

97.8 

27.1 

-  2.2 

32.0 

6 

99.3 

3.1 

-  0.7 

3.7 

7 

97.8 

23.3 

-  2.2 

30.0 

Baltimore 

-Washington  1 

90.2 

23  7.9 

-  9.8 

334.7 

2 

100.0 

0.0 

0.0 

0.0 

(100) 

3 

100.0 

0.0 

0.0 

0.0 

4 

100.0 

0.0 

0.0 

0.0 

5 

100.0 

0.0 

0.0 

0.0 

6 

100.0 

0.0 

0.0 

0.0 

7 

100.0 

0.0 

0.0 

0.0 

Rochester 

1 

87.4 

330.7 

-12.6 

488.3 

2 

100.0 

0.1 

0.0 

0.1 

(100) 

3 

100.0 

0.0 

0.0 

0.0 

4 

100.0 

0.1 

0.0 

0.1 

5 

100.0 

0.1 

0.0 

0.1 

6 

100.0 

0.0 

0.0 

0.0 

7 

100.0 

0.1 

0.0 

0.1 

Pooled 

1 

79.9 

449.7 

-20.1 

852.8 

2 

99.9 

0.3 

-  0.1 

0.3 

(100) 

3 

100.0 

0.0 

0.0 

0.0 

4 

99.9 

0.3 

-  0.1 

0.3 

5 

99.9 

0.3 

-  0.1 

0.3 

6 

100.0 

0.0 

0.0 

0.0 

7 

99.9 

0.3 

-  0.1 

0.3 

#  -  expected  payment  factor  @  -  variance  of  payment  factor 

$  -  correct  payment  factor  for  the  population 

*  -  payment  determination  method: 

1.  triple  numerical  integration 

2.  multiplying  the  individual  PWL  values 

3.  averaging  the  individual  PWL  values 

4.  using  the  smallest  individual  PWL  value 

5.  multiplying  the  individual  payment  factors 

6.  averaging  the  individual  payment  factors 

7.  using  the  smallest  individual  payment  factor 


SO 


greater.  If  the  3  properties  are  considered  to  be  non-correlated,  then 
this  is  equivalent  to  requiring  a  PWL  value  of  72.9  (.9  x  .9  x  .9  x  100) 
for  all  3  properties  considered  simultaneously.  As  shown  in  Table  21, 
this  number  could  be  even  lower  if  the  correlations  between  the 
properties  are  considered.  If  the  payment  schedule  in  Table  18  were 
modified  to  require  a  lower  PWL  value  for  full  payment,  then  the  large 
negative  biases  for  Method  1  would  be  reduced  in  Tables  22  and  23. 

Such  a  modification  in  the  payment  schedule  for  the  multiple 
Marshall  properties  would  probably  reduce  the  large  negative  biases,  but 
would  not  improve  the  high  variability  introduced  by  the  estimate  for 
the  correlation  coefficients  nor  would  it  reduce  the  large 
implementation  problems  associated  with  such  a  drastic  change  from 
current  practices.  It  would  therefore  seem  that  the  individual 
properties  approaches  are  preferred  over  the  integration  method  even 
though  the  integration  method  appears  to  be  the  most  theoretically  sound 
of  the  methods  considered. 

To  investigate  the  effect  of  the  number  of  samples  on  the 
integration  method,  a  sensitivity  analysis  was  conducted  in  which  the 
number  of  samples  per  day  was  allowed  to  vary  from  4  to  20.  Table  24 
presents  the  results  of  this  analysis.  The  pooled  values  for  means  and 
standard  deviatons  for  the  1981  projects  were  used  with  the  trend 
correlations  for  the  sensitivity  analysis.  As  seen  in  Table  24,  the 
Bias  is  reduced  from  -20.1  to  -0.2  as  the  number  of  samples  is  increased 
from  4  to  20.  At  the  same  time,  the  MSE  is  reduced  from  852.8  to  0.5. 
However,  it  is  not  reasonable  to  expect  to  obtain  more  than  4  Marshall 
tests  per  day  due  to  the  time  and  expense  involved.  This  establishes  a 
practical  limit  on  the  number  of  samples  that  can  be  obtained  and  tested 
in  a  paving  day. 

Selection  of  the  Payment  Determination  Method 

With  the  integration  approach  eliminated,  the  selection  of  the 
payment  determination  method  is  reduced  to  determining  which  of  the  3 
composite  approaches,  i.e.,  multiplying,  averaging  or  using  the  smallest 
individual  value,  provides  the  smallest  MSE  values.  It  is  also 
necessary  to  determine  whether  the  method  chosen  should  be  applied  to 
the  individual  PWL  values  or  to  the  individual  payment  factors.  As 
noted  previously,  the  averaging  method  provides  superior  results  for 
population  payment  values  near  100.  Since  9  of  the  15  projects 
considered  in  the  study  had  populaton  payment  factor  values  greater  than 
97,  the  averaging  method  was  selected  as  the  method  for  combining  the 
individual  property  values. 

It  was  next  necessary  to  select  between  averaging  the  individual 
PWL  values,  and  averaging  the  individual  payment  factors  to  determine 
the  composite  payment  factor.  Table  25  presents  a  summary  of  the  MSE 
results  for  averaging  the  PWL  values  (Method  3)  and  for  averaging  the 
payment  factors  (Method  6)  for  each  of  the  projects  simulated.  As  shown 
in  the  table,  there  is  little  difference  in  the  MSE  values  for  the  2 
methods  when  the  MSE  values  are  small.  However,  the  PWL  averaging 
method  (Method  3)  does  have  consistently  lower  values  in  this  range. 
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Table  24. 


Results  of  Sensitivity  Analysis  of  the  Effect  of  the  Number 
of  Samples  on  the  Bias  and  MSE  Results  for  the  Integration 
Method.  (Pooled  Means  and  Standard  Deviations  and  Trend 
Correlations) 


Number  of  Samples  Bias  MSE 


4 

6 

8 

10 

12 

14 

16 

18 

20 

-20.1 

-  6.5 

-  1.8 

-  0.5 

-  0.7 

-  0.5 

-  0.3 

-  0.2 
-  0.2 

852.8 

210.6 

42.3 

1.8 

5.5 

2.0 

1.1 

0.5 

0.5 

Table  25.  MSE  Values 

for  Methods  3  and  6 

for  the  Projects  Simulated 

Project 

Population 
Payment  Factor 

MSE 

(Method  3)* 

MSE 

(Method  6)* 

Adirondack-A 

50.0 

2403.8 

2208.8 

Adirondack-B 

95.5 

19.0 

21.4 

Chariot tesville-ANJ 

73.7 

1599.6 

1089.7 

Char lot tesville-SLW 

50.0 

1876.4 

1326.7 

Chautauqua 

100.0 

0.0 

3.3 

Cheraung-Chem 

100.0 

0.0 

3.5 

Chemung-Fish 

97.3 

6.7 

22.8 

Dubois 

85.3 

191.4 

169.8 

Dutchess 

99.4 

0.6 

5.8 

Linden 

100.0 

0.1 

3.6 

Westchester-Colp 

100.0 

0.1 

7.5 

Westchester-Peck 

50.0 

2153.0 

1771.0 

Atlantic  City 

100.0 

0.1 

3.7 

Baltimore-Washington 

100.0 

0.0 

0.0 

Rochester 

100.0 

0.0 

0.0 

Pooled 

100.0 

0.0 

0.0 

*  Method  3  -  averaging  the  individual  PWL  values 

Method  6  -  averaging  the  individual  payment  factors 


When  the  MSE  values  are  very  large  (for  low  population  payment  factors) 
the  payment  factor  averaging  method  (Method  6)  has  consistently  lower 
MSE  values. 

It  is  difficult  to  select  between  the  2  averaging  methods  since 
niether  is  consistently  superior  for  the  entire  range  of  population 
payment  factors  found  on  the  projects  studied.  The  individual  payment 
factor  averaging  method  is  closer  to  the  method  currently  being  employed 
for  calculating  mat  density  payments.  As  a  result,  it  may  be  more 
readily  implemented  and  accepted  by  the  parties  involved  on  actual 
projects.  For  this  reason  it  is  recommended  as  the  payment 
determination  method  for  the  Marshall  properties. 

Mar shall -Density  Payment  Factor  Determination 


One  factor  to  be  considered  in  the  application  of  the  composite 
Marshall  poroperties  payment  factor  is  the  relationship  between  this 
payment  factor  and  the  one  calculated  for  density.  If  a  strong 
correlation  exists  between  the  Marshall  properties  obtained  in  the 
laboratory  and  the  density  obtained  in  the  field,  then  it  might  be 
necessary  to  consider  this  correlation  when  determining  the  overall 
payment  factor  for  the  lot  of  material.  It  is  not  possible  to  determine 
directly  whether  such  correlations  exist  because  there  is  no  one-to-one 
correspondence  between  the  Marshall  test  results  and  the  field  density 
test  results. 

The  4  sets  of  Marshall  laboratory  densities  are  averaged  to 
determine  the  single  value  against  which  the  individual  field  density 
results  are  measured.  There  is,  therefore,  no  way  to  measure 
correlation  values  between  the  individual  field  density  results  and  the 
individual  Marshall  results.  Any  potential  effects  of  the  Marshall 
properties  on  the  compactability  of  the  asphalt  mixture  should  affect 
both  the  laboratory  density  and  the  field  density.  Since  the  field 
density  is  calculated  as  a  percentage  of  the  laboratory  density,  any 
caoinpactability  effects  associated  with  the  Marshall  properties  should 
be  accounted  for  in  the  calculation  of  the  field  density  values.  It 
would  therefore  not  seem  to  be  necessary  to  consider  any  correlation 
between  density  and  the  Marshall  properties  when  determining  the  overall 
payment  factor  for  the  lot. 

The  same  3  approaches  that  were  considered  for  establishing  a 
composite  payment  factor  for  the  Marshall  properties  can  be  considered 
for  combining  the  Marshall  payment  factor  and  the  density  payment 
factor.  These  approaches  are:  1)  multiplying  the  2  payment  factors,  2) 
averaging  the  2  payment  factors  and  3)  using  the  smaller  of  the  2 
payment  factors.  It  is  not  clear  which  of  these  approaches  is 
appropriate  because  it  is  not  possible  to  clearlv  establish  the 
correlation  relationship  between  the  Marshall  and  density  results. 

Using  the  averaging  approach  would  be  consistent  with  averaging  the  3 
Marshall  properties  tc  determine  t;.'  Marshall  properties  payment  factor. 
If  might  also  be  thought  of  as  being  consistent  with  averaging  the  4 
Marshall  laboratory  density  values  against  which  to  measure  the 
individual  field  density  test  .. 


CHAPTER  VII 


SUMMARY  AND  CONCLUSIONS 


This  report  presents  the  procedure  and  results  of  a  computer 
simulation  analysis  to  investigate  the  performance  of  a  number  of 
methods  for  determining  the  payment  factor  for  a  lot  of  materials  when  3 
acceptance  characteristics,  i.e.,  the  Marshall  stability,  flow  and  air 
voids,  are  employed.  Although  the  Marshall  properties  were  specifically 
addressed  in  this  study,  the  procedures  developed  can  be  applied  to  the 
case  of  any  3  correlated  properties.  A  total  of  7  different  methods 
were  considered  for  calculating  the  payment  factor.  These  methods 
include : 

1)  triple  numerical  integration  to  determine  the  overall  PWL 

2)  multiplying  the  individual  property  PWL  values 

3)  averaging  the  individual  property  PWL  values 

4)  using  the  smallest  individual  property  PWL  value 

5)  multiplying  the  individual  property  payment  factors 

6)  averaging  the  individual  property  payment  factors 

7)  using  the  smallest  individual  property  payment  factor. 

Marshall  test  results  from  15  runway  paving  projects  were  analyzed 
to  determine  the  means,  variances  and  correlation  coefficients  (among 
the  Marshall  properties)  that  are  obtained  on  actual  construction 
projects.  These  results  were  used  as  input  to  numerical  integration  and 
computer  simulaion  routines  to  evaluate  the  7  payment  determination 
methods  considered. 

A  numerical  integration  algorithm  for  the  trivariate  normal 
distribution  was  developed  to  calculate  the  total  volume  of  the  material 
that  fell  within  the  acceptance  limits  for  each  lot  of  material.  To 
verify  the  integrity  of  the  algorithm,  integration  results  for  the  zero 
correlation  case  were  compared  with  results  using  tables  of  the  standard 
normal  distribution.  The  integration  algorithm  agreed  closely  with  the 
results  derived  from  the  tables. 

Computer  simulation  was  used  to  investigate  the  performance  of  the 
various  methods  for  determining  the  payment  factor  for  multiple 
acceptance  properties.  Computer  simulation  was  used  to  develop  Marshall 
test  resits  for  100  paving  lots  using  the  results  from  the  15  paving 
projects  for  which  data  were  collected.  The  mean  square  payment  error 
(MSE)  for  each  of  the  methods  was  used  as  the  norm  and  the  minimum  MSE 
as  the  criterion  for  choice  among  the  methods. 
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The  following  findings  can  be  noted  iron  the 

1)  there  are  correlations  between  the  Marshall  properties  that  are 
statistically  significantly  different  from  zero, 

2)  numerical  integration  can  be  used  to  determine  the  overall- 
percentage  of  a  population  of  material  that  falls  within  the 
Marshall  properties  acceptance  Limits, 

3)  numerical  integration  with  a  digital  computer  is  necessary  to 
determine  the  tri. variate  PVL  value  for  the  Marshall  properties 
since  millions  of  tables  would  be  require!  if  numerical  integration 
were  not  used, 

4)  if  stability  is  considered  on  an  accept-or-r eject  basis,  then  19 
tables  are  necessary  to  estimate  the  bivariate  P.>E  for  flow  and  air 
voids , 

5)  in  the  simulation  analyses,  the  numerical  integration  method 
provided  very  large  MSE  values  as  compared  with  the  individual 
properties  methods  because  the  small  sample  size,  i.e.,  n=4,  does 
not  provide  a  good  estimate  of  the  population  correlation 
coefficients  that  must  be  used  in  the  integration  algorithm, 

6)  the  averaging  method  provides  the  smallest  MSE  values  for 
populations  with  high  PWL  values  (this  was  the  case  for  the 
majority  of  the  projects  for  which  data  were  available), 

7 )  there  is  little  difference  between  the  MSE  values  for  the  2 
averaging  methods  (i.e.,  averaging  the  PVL  values  or  averaging  the 
payment  factors), 

8)  the  method  which  averages  the  individual  property  payment 
factors  is  the  one  most  similar  to  the  method  currently  employed  by 
the  FAA  Eastern  Region  for  mat  density  payment  factor 
determination. 


Recommend a  t  ion 

The  payment  determination  procedure  that  is  recommended  for  the 
trivariate  case  of  the  Marshall  properties  is  the  individual  property 
payment  factor  averaging  method.  It  is  difficult  to  select  between  the 
2  averaging  methods  since  neither  is  consistently  superior  for  the 
entire  range  of  population  payment  factors  found  on  the  projects 
studied.  The  individual  payment  factor  averaging  method  is  closer  to 
the  method  currently  being  employed  for  calculating  mat  density 
payments.  As  a  result,  it  may  be  more  readily  implemented  and  accepted 
by  the  parties  involved  on  actual  projects.  For  this  reason  it  is 
recommended  as  the  payment  determination  method  for  the  Marshall 
properties. 


The  following  acceptance  procedure  for  determining  the  payment 
factor  for  the  Marshall  properties  is  recommended: 

1.  Using  the  random  sampling  procedures  in  the  FAA  Eastern  Region 
Laboratory  Procedures  Manual,  select  4  samples  from  each  lot  of 
material  for  Marshall  properties  determination, 

2.  For  each  Marshall  property,  i.e.,  stability,  flow  and  air 
voids,  determine  the  PWL  value  using  the  Quality  Index  approach 
outlined  in  the  Eastern  Region  P-401  specification. 

3.  Using  the  calculated  PWL  values  and  Table  18,  determine  the 
payment  factor  individually  for  each  of  the  3  Marshall  properties. 

4.  The  composite  payment  factor  associated  with  the  Marshall 
properties  is  then  calculated  as  the  average  of  the  3  individual 
payment  factors. 

5.  The  payment  factor  for  density  is  calculated  using  Table  18  and 
the  estimated  PWL  value  determined  by  the  Quality  Index  approach 
outlined  in  the  Eastern  Region  P-401  specification. 

6.  The  overall  payment  factor  for  the  lot  of  material  is 
calculated  as  the  average  of  the  Marshall  properties  payment  factor 
and  the  density  payment  factor. 
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First,  the  standardized  acceptance  limits  must  be  calculated  from 
the  following: 

16  -  (XBARF)  16  -  10.55 

__  =  -  =  +6.5 

0.84 


8  -  (XBARF) 


5  -  (XBARV) 


8  -  10.55 

-  =  -3.0 

0.84 


5  -  3.47 

-  =  +2.5 

0.62 


2  -  (XBARV)  2  -  3.47 

0.62 


Once  the  standardized  acceptance  limits  are  determined,  the  4  areas 
defined  above  can  be  calculated  from  the  bivariate  normal  table  for  a 
correlation  coefficient,  P,  of  -0.4,  The  areas  determined  for  the 
example  problem  are: 

(Fu.Vu)  =  98.95  [by  interpolating  between  Z2=2.4  and  2.6  on  the 

Zl=3.0  row  (3.0  is  the  largest  value  used  in 
the  tables)] 

(FI, VI)  =  0.00  [from  the  cell  with  Zl=-3.0  and  Z2=— 2 . 4 ] 

(Fl.Vu)  =  0.00 
(Fu.Vl)  =  0.70 


The  PWL  value  is,  therefore, 

PWL  =  (Fu, Vu)+(F1 , V1)-(F1 , Vu)-(Fu ,V1) 


PWL  «  98.95  +  0.00  -  0.00  -  0.70 
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APPENDIX  B 


BIVARIATE  NORMAL  TABLES 

This  appendix  presents  tables  for  determining  the  total  volume  of 
the  bivariate  distribution  that  falls  between  2  sets  of  upper  and  lower 
limits.  For  the  case  considered  in  this  research,  the  upper  and  lower 
limits  are  those  for  Marshall  flow  and  air  voids.  The  PWL  value  for  the 
population  can  be  determined  by  calculating  the  two  means  and  standard 
deviations  and  the  one  corelation  coefficient  for  flow  and  air  voids, 
and  then  using  the  tables  in  this  appendix.  An  example  illustrating  the 
use  of  the  bivariate  tables  for  determining  PWL  is  presented  below. 

As  developed  in  Chapter  V,  4  separate  values  must  be  determined 
from  the  bivariate  tables  to  calculate  each  PWL  value.  The  steps  in  the 
procedure  for  determining  the  bivariate  PWL  are  as  follows: 

1.  determine  the  mean  and  standard  deviation  values  for  flow  and 
air  voids,  and  the  correlation  coefficient  between  flow  and  air 
voids, 

2.  determine  the  upper  and  lower  standardized  limits  for  flow  and 
for  air  voids, 

3.  designate  the  upper  and  lower  standardized  limits  for  flow  as 
Fu  and  FI,  and  designate  the  upper  and  lower  standardized  limits 
for  air  voids  as  Vu  and  VI, 

4.  determine  the  4  volumes  (Fu,Vu)  (FI, VI)  (Fu,Vl)  and  (Fl,Vu) 
using  the  bivariate  table  for  the  value  of  the  correlation 
coefficient,  P,  and 

5.  calculate  PWL  from  PWL  =  (Fu,Vu)+(Fl,Vl)-(Fl,Vu)-(Fu,Vl) . 

A  numerical  example  will  help  to  illustrate  the  proper  use  of  the 
tables.  Let, 

XBARF  =  10.55  be  the  mean  for  flow, 

STDF  =  0.84  be  the  standard  deviation  for  flow, 

XBARV  =  3.47  be  the  mean  for  air  voids, 

STDV  =  0.62  be  the  standard  deviation  for  air  voids  and 

P  =  -0.40  be  the  correlation  between  flow  and  air  voids, 

then  the  bivariate  PWT,  value  can  be  calculated  as  follows. 
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APPENDIX  C 


PROGRAM  USER'S  GUIDE 

This  appendix  presents  the  necessary  instructions  for  using  the 
computer  simulation  program  that  was  developed  during  the  research 
effort.  The  program  can  be  used  to  simulate  100  paving  days  of  Marshall 
test  results  to  investigate  the  performance  of  different  methods  for 
determining  the  payment  to  be  received  for  the  lot  of  material.  The 
program  uses  the  current  FAA  Eastern  Region  payment  schedule  to 
determine  the  payment  factor  for  the  estimated  PWL  values.  Although  the 
Marshall  properties  were  specifically  addressed  in  this  study,  the 
program  can  be  used  for  any  correlated  trivariate  case  by  inputting  the 
appropriate  acceptance  limits. 

The  program  determines  a  composite  Marshall  payment  factor  using  7 
different  methods,  including: 

1.  triple  numerical  integration  to  determine  the  overall  PWL 

2.  multiplying  the  individual  property  PWL  values 

3.  averaging  the  individual  property  PWL  values 

4.  using  the  smallest  individual  property  PWL  value 

5.  multiplying  the  individual  property  payment  factors 

6.  averaging  the  individual  property  payment  factors 

7.  using  the  smallest  individual  property  payment  factor. 

Computer  System  Information 

The  program  was  written  in  FORTRAN  and  has  been  successfully 
executed  using  the  FORTRAN77  and  WATFIV  compilers  and  an  IBM  3081-K 
main-frame  computer.  The  program  should  run  on  any  system  supporting 
the  F0RTRAN77  language.  The  program  is  supplied  on  computer  tape  and  a 
complete  program  listing  is  also  presented  in  Appendix  D.  The  program 
is  entitled  ACCEPT,  and  it  appears  under  this  data  set  name  on  the  tape. 
The  necessary  information  to  identify  the  tape  and  the  program  are 
listed  below. 

Volume  Serial  Number:  BURATI 

Label:  IBM  standard  label 

Density:  6250  bpi 

Tracks:  9  tracks 

Contents  of  Tape:  File  Number  Data  Set  Name 

1  ACCEPT 
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The  required  input  data  for  the  ACCEPT  program  include: 


1.  the  acceptance  limits  for  the  properties  being  considered, 

2.  the  means  for  the  properties  being  considered  and 

3.  the  variance-covariance  matrix  for  the  properties  being 
considered. 

Acceptance  Limits 

The  program  can  be  used  to  simulate  any  trivariate  acceptance 
situation.  All  that  is  necessary  is  that  the  upper  and  lower  acceptance 
limits  for  the  3  properties  being  considered  be  entered  as  program 
input.  For  the  Marshall  properties,  the  limits  used  in  the  simulations 
in  the  current  research,  the  acceptance  limits  were: 

1800  <  stability  <  8000 

8  <  flow  <  16 

2  <  air  voids  <  5. 

The  program  is  designed  for  both  upper  and  lower  acceptance  limits.  In 
the  case  of  a  property  with  no  upper  limit,  such  as  stability,  it  is 
necessary  to  input  an  artificial  upper  limit.  This  limit  can  be 
arbitrarily  selected  to  insure  it  is  so  high  that  none  of  the  simulated 
values  will  exceed  it. 

Mean  Values 


The  next  data  input  to  the  program  are  the  mean  values  for  the  3 
properties  being  simulated.  These  are  the  mean  values  for  the 
population  from  which  the  simulated  Marshall  test  results  are  drawn.  In 
the  research,  the  values  from  the  15  runway  paving  projects  were  used  as 
the  'population  statistics'  in  the  various  simulation  analyses. 

Variance-Covariance  Matrix 


The  final  input  data  to  the  program  are  the  values  for  the 
variance-covariance  matrix  for  the  3  properties  being  simulated.  The 
variance  for  each  property  can  be  calculated  as  the  square  of  the 
standard  deviation  for  the  property.  The  covariance  for  each  pair  of 
properties  can  be  calculated  from  the  standard  deviations  for  the 
properties  and  the  correlation  coefficient  between  the  properties. 
Correlation  coefficients  can  be  estimated  from  those  presented  in  this 
report,  or  can  be  calculated  from  historical  data  using  the  formula 
presented  in  Chapter  II.  Many  hand-held  calculators  also  have  built-in 
routines  for  calculating  the  correlation  coefficient  between  2  sets  of 
variables.  A  numerical  example  will  help  to  illustrate  the  process  for 
calculating  covariances. 


Suppose  the  following  is  known  about  a  population  of  Marshall 
properties  to  be  simulated: 

STDs  =  stability  standard  deviation  =  243.8 

STDf  =  flow  standard  deviation  =  0.84 

STDv  =  air  voids  standard  deviation  =  0.62 

C,sf  =  correlation  between  stability  and  flow  =  +0.30 

C,sv  =  correlation  between  stability  and  air  voids  =  -0.40 

C,fv  =  correlation  between  flow  and  air  voids  =  -0.40. 

These  are  the  pooled  standard  deviation  values  from  the  1981  paving 
projects  and  the  trend  correlation  values  developed  from  all  the 
projects  considered  in  the  research. 

The  variance  for  each  of  the  properties  can  be  calculated  as 
follows : 

VARs  =  stability  variance  =  (STDs)2  =  (243. 8)2  =  59,438 

VARf  =  flow  variance  =  (STDf)2  =  (  0.84)2  =  0.706 

VARv  =  air  voids  variance  =  (STDv)2  =  (  0.62 f  =  0.384. 

The  covariance  values  can  be  calculated  from  the  standard  deviation 
and  correlation  coefficient  values  by  the  following  relationship: 

if, 

C0V,xy  =  covariance  between  properties  X  and  Y 

C,xy  =  correlation  coefficient  between  properties  X  and  Y 

STDx  =  standard  deviation  of  property  X 

STDy  =  standard  deviation  of  property  Y 

then, 

C0V,xy  =  (C.xy)  *  (STDx)  *  (STDy). 
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Therefore,  for  the  example  being  considered,  the  covariances  are: 


COV,sf  -  (C,sf )  *  (STDs)  *  (STDf ) 

=  (0.30)  *  (243.8)  *  (0.84)  =  61.438 

COV.sv  =  (C,sv)  *  (STDs)  *  (STDv) 

=  (-0.40)  *  (243.8)  *  (0.62)  =  -60.462 

COV.fv  =  (C,fv)  *  (STDf)  *  (STDv) 

=  (-0.40)  *  (0.84)  *  (0.62)  =  -  0.208. 


The  variance-covariance  matrix  can  be  represented  as: 


stability 

flow 

air  voids 

stability 

59438. 

61.438 

-60.462 

flow 

61.438 

0.706 

-  0.208 

air  voids 

-60.462 

-  0.208 

0.384 

Input  Cards  or 

Lines 

All  input  values  in  the  program  are  in  the  free  format  mode  and  are 
real  vriables  (i.e.,  they  require  a  decimal  point).  A  summary  of  the 
input  values  is  presented  below: 

Line 

Variables 

1 

lower  limit  and 

upper  limit  for 

stability 

2 

lower  limit  and 

upper  limit  for 

flow 

3 

lower  limit  and 

upper  limit  for 

air  voids 

4 

mean  stability, 

mean  flow  and  mean  air  voids 

5 

stability  variance,  stability-flow  covariance  and 
stability-air  voids  covariance 

6 

stability-flow  covariance,  flow 
flow-air  voids  covariance 

variance  and 

7 

stability-air  voids  covariance, 
and  air  voids  variance. 

flow-air  voids  covariance 

Using  the  notation  presented  above,  and  defining  the  stability,  flow  and 
air  voids  means  by  XBARs,  XBARf  and  XBARv,  respectively,  and  the  upper 
and  lower  limits  for  stability,  flow  and  air  voids  as  ULs,  LLs,  ULf, 

LLf,  ULv  and  LLv,  respectively,  the  data  input  can  be  summarized  as: 


83 


Line 


Variables 


Example  Problem  Values 


1 

LLs  ULs 

1800. 

8000. 

2 

LLf  ULf 

8.  16 

• 

3 

LLv  ULv 

2.  5. 

4 

XBARs  XBARv 

XBARv 

2671.8 

10.55  3.47 

5 

VARs  COV.sf 

COV.sv 

59438. 

61.438  -60.462 

6 

C0V,sf  VARf 

C0V,fv 

61.438 

0.706  -0.208 

7 

COV.sv  C0V, 

fv  VARVv 

-60.462 

-0.208  0.384 

Program 

Output 

The  output  from  the  program  consists  of  the  input  data,  the 
population  PWL  and  payment  factor,  and  the  average  values  from  the 
projects  simulated.  The  program  simulates  7  different  payment 
determination  methods.  The  7  methods  are  identified  on  the  program 
output,  and  include: 

1.  triple  numerical  integration 

2.  multiplying  the  individual  PWL  values 

3.  averaging  the  individual  PWL  values 

4.  using  the  smallest  individual  PWL  value 

5.  multiplying  the  individual  payment  factors 

6.  averaging  the  individual  payment  factors 

7.  using  the  smallest  individual  payment  factor. 

The  output  for  the  program  first  prints  an  echo  of  the  input  data. 
The  program  then  reports  the  PWL  value  for  the  population  along  with  the 
payment  factor  based  on  the  population  PWL  value.  In  addition,  the 
following  average  values  for  the  100  paving  days  are  reported  for  each 
of  the  7  payment  determination  methods: 

1.  the  mean  of  the  100  payment  factors 

2.  the  standard  deviation  of  the  100  payment  factors 

3.  the  variance  of  the  100  payment  factors 

4.  the  bias 

5.  the  mean  square  error  (MSE)  of  the  payment  factors. 

A  sample  output  for  program  ACCEPT  for  the  data  from  the  example 
project  in  this  appendix  is  presented  in  Exhibit  C-l .  The  first  3  lines 
are  the  lower  and  upper  acceptance  limits  for  stability,  flow  and  air 
voids,  respectively.  The  next  line  presents  the  population  mean  values 
for  stability,  flow  and  air  voids.  Next,  the  variance-covariance  matrix 
is  printed.  This  allows  the  user  to  verify  that  the  correct  values 
were  input  to  the  program.  The  program  then  prints  the  population  PWL 
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value  and  the  corresponding  payment  factor.  Finally,  the  simulation 
results  are  reported. 


Modifying  the  Payment  Schedule 


The  program  uses  the  current  FAA  Eastern  Region  density  payment 
schedule  for  determining  the  payment  factor  for  the  PWL  values  that  are 
estimated.  If  the  user  wishes  to  evaluate  the  performance  of  different 
price  adjustment  (i.e.,  payment  )  schedules,  then  the  program  statements 
corresponding  to  the  payment  factor  determination  must  be  modified  to 
reflect  the  different  payment  schedule.  The  statements  that  must  be 
modified  to  use  a  different  payment  schedule  can  be  identified  in  the 
program  listing  in  Appendix  D. 


In  Appendix  D,  the  first  column  of  numbers  are  the  statement 
numbers  for  the  program.  The  column  of  numbers  on  the  right  side  of  the 
page  are  the  individual  line  numbers  assigned  to  each  line  of  the 
program.  The  payment  factors  are  calculated  at  3  different  locations  in 
the  program.  These  locations  are:  statements  22  -  25,  statements  40  - 
43,  and  statements  46  -  49. 


In  statements  22  -  25,  ACT  is  the  population  PWL  value,  and  PAYFAC 
is  the  payment  factor  calculated  using  the  population  PWL  value.  In 
statements  40  -  43,  PI (I)  for  I  =  1,2,3  are  the  composite  PWL  values 
determined  by  multiplying,  averaging,  and  using  the  smallest  of  the 
individual  PWL  values;  and  P2(I)  for  I  =  1,2,3  are  the  corresponding 
composite  payment  factors.  In  statements  46  -  49,  PWL(I)  for  I  =  1,2,3 
are  the  individual  PWL  values  for  stability,  flow  and  air  voids;  and 
P(I)  for  I  =  1,2,3  are  the  corresponding  individual  property  payment 

factors.  PWL(I)  for  I  =  4  in  statements  46  -  49  represents  the  PWL 
calculated  by  triple  integration;  and  P(I)  for  I  =  4  is  the 
corresponding  payment  factor. 


An  example  will  help  to  illustrate  how  the  program  can  be  modified 
to  use  a  different  payment  schedule.  Suppose  the  following  payment 
schedule  is  being  considered • 


Estimated  PWL  Payment  Factor _ 

50  -  100  pay  factor  =  estimated  PWL 

Below  50  50. 


If  this  payment  schedule  were  to  be  evaluated,  the  statements  22  -  25 
would  be  removed  and  replaced  with  the  following  statements: 


IF( ACT  ,GE.  50)  PAYFAC  =  ACT 
IF(ACT  .LT.  50)  PAYFAC  =  50. 


~~  •  — "  ■■  . 
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and,  statements  40  -  43  would  be  removed  and  replaced  with  the  following 
statements: 

IF(P1(I)  .GE.  50)  P2(I)  =  P1(I) 

IF(P1(I)  .LT.  50)  P2(I)  =  50. 

and,  statements  46  -  49  would  be  removed  and  replaced  with  the  following 
statements: 


IF(PWL(I)  .GE.  50)  P(I)  =  PWL(I) 
IF(PWL(I)  .LT.  50)  P(I)  =  50. 


STAB  LIMITS  =  1800.0  AND  8000.0 

FLOW  LIMITS  =  8.00  AND  16.00 

VOIDS  LIMITS  =  2.00  AND  5.00 


MEANS  FOR  STAB,  FLOW,  AND  VOIDS  =  2672.00  10.55  3.47 


VARIANCE-COVARIANCE  MATRIX 

59438.4414  61.4376  -60.4624 

61.4376  0.7056  -0.2083 

-60.4624  -0.2083  0.3844 


POP  PWL  =  96.96  POP  PAY  FACTOR  =  100.00 


METHOD 

MEAN 

STD  DEV 

VARIANCE 

BIAS 

MSE 

1 

79.9 

21.2 

449.7 

-20.1 

852.8 

2 

99.9 

0.5 

0.3 

-0.  1 

0.3 

3 

100.0 

0.0 

0.0 

0.0 

0.0 

4 

99.9 

0.5 

0.3 

-0.1 

0.3 

5 

99.9 

0.5 

0.3 

-0.  1 

0.3 

6 

100.0 

0.2 

0.0 

-0.0 

0.0 

7 

99.9 

0.5 

0.3 

-0.1 

0.3 

METHOD 

1.  TRIPLE  NUMERICAL  INTEGRATION 

2.  MULTIPLYING  THE  INDIVIDUAL  PWL  VALUES 

3.  AVERAGING  THE  INDIVIDUAL  PWL  VALUES 

4.  USING  THE  SMALLEST  INDIVIDUAL  PWL  VALUE 

5.  MULTIPLYING  THE  INDIVIDUAL  PAYMENT  FACTORS 

6.  AVERAGING  THE  INDIVIDUAL  PAYMENT  FACTORS 

7.  USING  THE  SMALLEST  INDIVIDUAL  PAYMENT  FACTOR 


EXHIBIT  C-l.  SIMULATION  PROGRAM  OUTPUT  FOR  THE  EXAMPLE  PROBLEM 


APPENDIX  D 


000001 


000002 

000003 

000004 

000005 

000006 

000007 

000008 

000009 
000010 
00001  1 
000012 
000013 
000014 
000015 
000016 
000017 
000018 
000019 
000020 
000021 
000022 
000023 
000024 
000025 
000026 
000027 
000028 
000029 
000030 
000031 
000032 
000033 
000034 
000035 
000036 
000037 
000038 
000039 
000040 
00004 1 
000042 
000043 
000044 
000045 
000046 
00004 r 

000048 
00004 9 

000050 
00005 1 
00005? 
000053 
000064 
000055 


SIMULATION  PROGRAM  LISTING 


DIMENSION  CV(  3 , 3 ) , B(  3 , 3 ) , XBAR( 7 ) . COV( 7 , 7 ) , AVG( 3 ) . STD( 3 } , R( 3 , 3 ) , 

1  PAY  (  1 00 , 7 ) , AV( 3 ) , U( 20 ) , V( 20 ) , PWL ( 7 ) , P( 7 ) ,  B I AS( 7 ) , X( 20 , 3 ) , P 1 ( 3 ) , 
1P2( 3) 

REAL  MSE( 7 ) 

DO  10  1=1,3 
READ  88, U(  I ),V(  I  ) 

88  FORMAT ( 2F10 . 0  ) 

10  CONTINUE 

PRINT  40,  U( 1 ),V( 1 ) ,U(2),V!2 ) ,U( 3), V( 3) 

40  FORMAT ( // '  STAB  LIMITS  =  ,F6.1,  AND  '.F6.1,/,'  FLOW  LIMITS  = 

+F6 . 2, '  AND  1 , F6 . 2 , / , '  VOIDS  LIMITS  =  ',F6.2,'  AND  ',F6.2) 

READ  89,<AV( I ), 1=1,3) 

89  FORMAT ( 3F10.0) 

PRINT  50, ( AV(  I  ) ,  1  =  1 , 3  ) 

50  FORMAT!//1  MEANS  FOR  STAB,  FLOW,  AND  VOIDS  =  \3F10.2) 

PRINT  60 

60  FORMAT!//'  VARIANCE-COVARIANCE  MATRIX'/) 

00  15  1=1,3 

REAO  86, (CV(  I  ,  J  )  , J=  1 , 3  ) 

86  FORMAT! 3F10.0 ) 

15  PRINT  70, ( CV( I , J ) , J= 1 , 3 ) 

CALL  CAL( AV, CV, U , V, ACT ) 

ACT=ACT*100. 

PAYFAC=0 . 

IF( ACT  .GE.  90)  PAYFAC= 100 . 

I F ( AC T  . LT .  90  .AND.  ACT  .GE.  80)  PAYFAC=  .5*ACT+55. 

IF( ACT  .LT.  80  .AND.  ACT  .GE.  65)  PAYFAC=  2.*ACT-65. 

IF( ACT  .LT.  65)  PAYFAC=50 . 

PRINT  80,  ACT , PAY FAC 

80  FORMAT!//'  POP  PWL  =  \F6.2,'  POP  PAY  FACTOR  =  '  ,  F6 . 2 ) 

70  FORMAT! 3F12.4) 

CALL  SCDA(CV.B) 

N  SAM  PL  =  4 
12=341547 
M=  1 

00  5  I  TER  =  1 .250 

CALL  S I M ( AV , B , U , V , PWL, I Z , ERR , AVC , STD, R , NSAMPL , X ) 

I  F( ERR  . EQ.  1  )  GO  TO  5 

PI ( 1 )=( PWL ( 1 )*PWI ( 2)*PWL( 3 ) )/ 10000. 

PI ( 2 )  —  ( PWL( 1 )  +  PWL ( 2 )+PWL< 3 ) ) / 3 . 

PI ( 3 )  =  ( AMIN1 ( PWL(  1  ) , PWL ( 2 ) , PWL( 3 )  )  ) 

00  2  1=1,3 

I F( PI (  I  )  .GE.  90  )  P2(  I  )=100. 

I F ( P 1 (  1  )  .LT.  90  .AND.  P 1 (  I  )  .GE.  80)  P2(  I  )= . 5*P 1 (  I )+55 

lf(Pl(l)  .LT.  80  .ANO.  P 1 ( I )  .GE.  65)  P2 ( I ) =2 . *P1 ( I ) -65 

IF( P 1 (  I  )  .LT.  65)  P2(  I  )  =  50. 

?  CONTINUE 
DO  1  1=1.4 

I F ( PWl (  I  )  .GE.  90  )  P(  I  )= 100. 

I f ( PWL ( I )  .LT.  90  .AND.  PWl ( 1 )  .GE.  80)  P ( I ) = . 5* PWL ( I ) +55 

I F (  PWL (  I  )  . L  F .  80  .AND.  PWL(I)  .GE.  65)  P(  I  ) =2 . *PWL(  I j -65 

I r ( PWL! I )  . LT .  65 )  P( I )  =  50. 

1  CONTINUE 

PAY  (  M , 2 )  =  P2 (  1  ) 

PAY(M,3)=P2(2) 

PAY  (  M ,  4  )  =  P2  (  3  ) 

PAY ( M, 5  )  =  ( P(  1 )  *  P( 2 )  »  P ( 3 ) ) / 1 0000 . 

PA  .'  (  M ,  6  )  =  (  P(  1  )  +  P(2)  +  P(  3)  )/3. 


00000040 

00000050 

00000060 

00000070 

00000080 

00000090 

00000100 

00000110 

00000120 

,00000130 

00000140 

00000150 

00000160 

00000170 

00000180 

00000190 

00000200 

00000210 

00000220 

00000230 

00000240 

00000250 

00000260 

00000270 

00000280 

00000290 

00000300 

00000310 

00000320 

00000330 

00000340 

00000350 

00000360 

00000370 

00000380 

00000390 

00000400 

00000410 

00000420 

00000430 

00000440 

00000450 

00000460 

00000470 

00000480 

00000490 

00000500 

00000510 

00000520 

00000530 

00000540 

00000550 

00000560 

00000570 

00000580 

00000590 

00000600 

00000610 


(CONTINUE) 


88 


1 

r.  -* 

ft 

000056 

PAY( M, 7 )= ( AM IN1(P(1),P(2),P(3))) 

00000620 

000057 

PAY ( M, 1 )=P( 4 ) 

1 F ( M  . EQ. 100  )  GO  TO  22 

00000630 

.  % 

000058 

00000640 

000059 

M=M+1 

00000650 

000060 

5  CONTINUE 

00000660 

*  '  ■ 

000061 

22  CONTINUE 

00000670 

- 

000062 

CALL  STAT( PAY, X8AR, COV, 100,7) 

00000680 

000063 

PRINT  90 

00000690 

000064 

90  FORMAT ( // '  METHOD  MEAN  STD  DEV  VARIANCE 

BIAS 

M00000700 

m 

D 

+  SE  '/) 

00000710 

000065 

DO  25  1=1,7 

00000720 

000066 

B 1 AS( 1 )=XBAR( 1 ) -  PAYFAC 

00000730 

000067 

MSE( 1 )=COV{ 1,1)  +  BIAS(I)  *  BIAS(I) 

00000740 

-  " 

000068 

25  PRINT  30,1, XBAR( 1 ) , SQRT ( COV( 1,1)), COV( 1 , 1 ) , B 1 AS( 1 ) , MSE(  1 ) 

00000750 

000069 

30  FORMAT { 1 10,5F10. 1 ) 

00000760 

\  -  ■ 

000070 

PRINT  64 

00000770 

000071 

64  FORMAT (/3X, 'METH0D'/7X,  '1  .  TRIPLE  NUMERICAL  1  NTEGRAT 1  ON  /7X, 

00000780 

. 

*'2.  MULTIPLYING  THE  INDIVIDUAL  PWL  VALUES' ,/7X, 

00000790 

■ 

*'3.  AVERAGING  THE  INDIVIDUAL  PWL  VALUES', /'IX, 

*'4.  USING  THE  SMALLEST  INDIVIDUAL  PWL  VALUE', /7X, 

*'5.  MULTIPLYING  THE  INDIVIDUAL  PAYMENT  FACTORS' , /7X, 

00000800 

00000810 

00000820 

* ' 6 .  AVERAGING  THE  INDIVIDUAL  PAYMENT  FACTORS ’, /7X , 

00000830 

*’ 7.  USING  THE  SMALLEST  INDIVIDUAL  PAYMENT  FACTOR’) 

00000840 

000072 

STOP 

00000850 

k. 

000073 

END 

00000860 

• 

000074 

SUBROUTINE  S 1 M( AV, B , USPEC, VSPEC, PWL,  1 Z, ERR, XBAR , STD, COR, NSAMPL,  X )  00000870 

c 

**  GENERATE  THE  VECTOR  OF  MARSHALL  VARIABLES  FOUR  TIMES 

00000880 

c 

**  COMPUTE  SAMPLE  STATISTICS  FROM  THE  FOUR  SAMPLES 

00000890 

■ 

000075 

DIMENSION  AV{ 3 ) , XBAR( 3 ) , Z( 3 ) , PWL( 7),A(3),D(3),QL(3),QU(3), C0R(  3 , 

3)00000900 

1,STD(3),B(3,3),C(3,3),U(3),V(3),X( NSAMPL, 03),USPEC(3) 

VSPEC( 3 ) , 

00000910 

2R( 3,3) 

00000920 

000076 

NVAR=3 

00000930 

000077 

DO  15  M=1 , NSAMPL 

00000940 

000078 

DO  5  1=1, NVAR 

00000950 

000079 

5  Z(  1  )  =  RNOR(  IZ) 

00000960 

000080 

DO  10  1=1, NVAR 

00000970 

00008  1 

X(M, 1 )=AV( 1 ) 

00000980 

000082 

DO  10  J=1,  1 

00000990 

000083 

10  X(M,  1 )=X(  M,  1  )+B(  l,J)*Z(J) 

00001000 

000084 

15  CONTINUE 

00001010 

o 

000085 

CALL  STAT(X, XBAR, C, NSAMPL, NVAR) 

00001020 

000086 

DO  20  1=1, NVAR 

00001030 

>.  ■. 

000087 

20  STO(  1  )  =  SQRT(C(  1  ,  !  ) ) 

00001040 

* 

000088 

DO  30  1=1, NVAR 

00001050 

000089 

DO  25  J= 1 , NVAR 

00001060 

*  * 

000090 

R(  l,J)=C(  1 ,J )/(  STD{  1  )*STD(J)) 

00001070 

000091 

25  COR (  1  ,J  )  =  R(  1 , J ) 

00001080 

m 

000092 

Ql.(  1  )  =  (  XBAR (  1  )-USPEC(  1  )  ) / STD (  1  ) 

00001090 

m 

000093 

QU(  1  )  =  ( VSPEC(  1  )  -XBAR (  1 )  )/STD(  1  ) 

OOOt)  1  1  00 

jp 

*  000094 

U(  1  )  =  (  USPEC(  1  )-XBAR(  1  ) )/STD(  I  ) 

ooooi  i  io 

000095 

V( 1 )=( VSPEC( 1 )-XBAR( 1 ) )/STD( 1 ) 

00001 120 

000096 

1  F ( U (  1 )  .LT.  -3.5)  U{  1  )  =  -3 . 5 

OOOOI 1 30 

000097 

1  F ( V (  1 )  .GT.  3.5)  V(  1 )=  3.5 

00001 140 

000098 

30  CONTINUE 

OOOOI 150 

000099 

CALL  SUM(U,V,ANS,R, NVAR, ERR) 

OOOOI 160 

000100 

PWL( 4 )  =  ANS* 1 00 . 

OOOOI  1  70 

* 

000101 

DO  40  K=1 , NVAR 

OOOOI 180 

A 

000102 

C=QL( K ) 

0000 1 1 90 

w 

000103 

H=QU( K ) 

00001200 

[. 

000104 

A(  1  )  =  U(  K  ) 

00001210 

000105 

D(  1  )=V(K) 

00001220 

•- 

000 1 06 

40  PWL(K)  =  PWLHAT ( G , H ) 

00001230 

000107 

RETURN 

00001240 

l 

000108 

END 

00001240 

. 

(CONTINUE) 

1  * 

• 

89 

. ■. .%//;  ./**• 

•:  ;•  :  w,VJ 

000109 
000  1  1  0 
0001  1  1 
0001  12 
0001  1 .1 
000  1  1 !« 


0001  15 
0001  16 
000 1  1  7 
0001  18 
0001  19 
000 1 20 
000121 
000122 
000123 
000124 
000125 
000126 
000127 
000128 
000129 


FUNCTION  FUN( X, R . NVAR , ERR  ) 

DIMENSION  R(3,3),L(3),M(3),X(3),Y(3,3),Z(3,3) 
I  I  (NVAR  .GT.  1  )  GO  TO  5 

rUN=( 1 ,/SQRT(6.2836) )*  EXP(-0.5*X( 1 )*X( 1 ) ) 

GO  TO  15 

5  DET=  R(  1 , 1 )*(R(2,2)*R(  3, 3 )-R( 3,2)*R(2, 3  )  ) 

1  -R(2,1)*(R(1,2)*R(3,3)-R(3,2)*R(1,3)) 

2  +R(3, 1 )#(R( 1 ,2)*R(2,3)-R(2,2)*R( 1,3)  ) 

ERR  - 1 . 

I F ( DET  .LE.  0. )  GO  TO  15 

E  R  R  -  0  . 

OS- SORT ( OET ) 

C0NST=1 ,/(6.2836*#1 .5  *  DS) 

CALL  M I NV( R , NVAR , E , L , M ) 

CAL  L  CMPRD( X, R, Y, 1,3,3) 

CALL  GMPRD( Y,  X, Z , 1,3,1) 

Z1=-0.5*Z( 1,1) 

I T(Z1 . LT. -160)  GOTO  10 
FUN-CONST#( EXP( Z 1 ) ) 

GOTO  15 
10  FUN-O. 

15  RETURN 
ENO 


00001260 
00001270 
00001280 
00001290 
00001300 
00001310 
00001320 
00001330 
00001340 
00001350 
00001360 
00001370 
00001380 
00001390 
00001400 
00001410 
00001420 
00001430 
00001440 
00001450 
00001460 
00001470 
00001480 


000130  FUNCT ION  RNOR( I R ) 

C  GENERATES  A  RANDOM  NORMAL  NUMBER 
000131  DATA  1/0/ 

000132  I F ( I . GT . 0 )  GOTO  30 

000133  10  CALL  RANDU( I R , I RR, U ) 

000134  I R= I RR 

000135  X=2 . 0*U- 1 . 0 

000136  CALL  RANDU( IR, IRR.U) 

000137  IR-IRR 

000138  Y-2 . 0#U- 1 . 0 

000139  S-X*X+Y*Y 

000140  I  F( S.GE. 1 .  )G0T0  10 

000141  S=SQRT( -2 . 0*AL0G(  S )/S ) 

000142  RNOR=X*S 

000143  G02  =  Y*S 

000144  1=1 

000145  GO  1 0  40 

000146  30  RN0R=G02 

000147  1-0 

000148  40  RETURN 

000149  ENO 


00001490 

00001500 

00001510 

00001520 

00001530 

00001540 

00001550 

00001560 

00001570 

00001580 

00001590 

00001600 

00001610 

00001620 

00001630 

00001640 

00001650 

00001660 

00001670 

00001680 

00001690 


000150  SUBROUTINE  SCDA(C,R) 

000151  DIMENSION  C( 3, 3 ) ,R( 3, 3  ) 

000152  R( 1 ,2)=0. 

000153  H ( 1 , 3 ) =  0 . 

000154  R ( 2 , 3  )  =  0 . 

000155  00  15  K- 1 , 3 

000156  R (  F , K )  =  SQR  T ( C ( K . K ) ) 

000157  00  10  J-1 , 3 

000158  IF(J.LE.K)  GOTO  10 

000159  R( J,K)=C( J,K)/R(K,K) 

000160  KK  K+1 

000161  00  5  l=KK.J 

000162  C(), I ) =C( J , I )-C( l,K)*C(J,K)/C(K,K) 

000163  5  CON  II  NOE 

000164  10  CONTINUE 

000165  '5  CONTINUE 

000166  K!  1  URN 

000  16  7  IN!) 


00001700 
00001710 
00001720 
00001 730 
00001740 
00001750 
00001760 
00001770 
00001780 
00001790 
00001800 
00001810 
00001820 
00001830 
00001840 
00001850 
0000 1 8 60 
000018  70 


000168  SUBROUTINE  CMPRD(  A, B, R, N. M, L) 

000169  DIMENSION  A< 1 ),B(  1 ),R(  1 ) 

000170  I R=0 

000171  IK=-M 

000172  DO  10  K=1,l 

000173  I K= I K+M 

000174  DO  10  J  =  1 ,  N 

000175  I R= I R+1 

000176  J  I  =J-N 

000177  I B= I K 

000178  R(IR)=0 

000179  OO  10  1  =  1,  M 

000180  J  I  =J I +N 

000181  I B= I  8+1 

000182  10  R(  IR)  =  R( IR)+A(JI )*B(  IB) 

000183  RETURN 

000184  END 


(CONTINUE) 


00001880 

00001890 

00001900 

00001910 

00001920 

00001930 

00001940 

00001950 

00001960 

00001970 

00001980 

00001990 

00002000 

00002010 

00002020 

00002030 

00002040 


000185 

SUBROUT  1 NE  STAT( X.XBAR, COV, NSAMPL, NVAR ) 

00002050 

000186 

D 1  MENS  1  ON  X( NSAMPL,  NVAR ) ,  XBAR( NVAR ) , C0V( NVAR, NVAR ) 

00002060 

C 

COMPUTE  SAMPLE  MEAN  OF  VARIABLE  1 

00002070 

000187 

DO  45  1=1, NVAR 

00002080 

000188 

XBAR( 1 )=0. 

00002090 

000189 

DO  40  M=1, NSAMPL 

00002100 

000190 

40 

XBAR( 1 )=XBAR( 1 )+X(M, 1 ) 

00002110 

000191 

45 

XBAR( 1 )=XBAR( 1 ) /FLOAT( NSAMPL ) 

00002120 

C 

COMPUTE  THE  SAMPLE  COVARIANCE 

00002130 

000192 

DO  60  1=1, NVAR 

00002140 

000193 

DO  55  J= 1 , NVAR 

00002150 

000194 

SUM=0 , 

00002160 

000195 

DO  50  M=1, NSAMPL 

00002170 

000196 

50 

SUM=SUM+X(M, 1 ) *X( M, J ) 

00002180 

000197 

SUM= SUM- NSAMPL* XBAR( 1 )*X8AR(J) 

00002190 

000198 

55 

COV( 1 , J )=SUM/FLOAT( NSAMPL- 1 } 

00002200 

000199 

60 

CONTINUE 

00002210 

000200 

RETURN 

00002220 

000201 

END 

00002230 

91 


000 202 

SUBROUTINE  SUM! U , V, ANS, C, N , ERR ) 

00002240 

000203 

DIMENSION  X(9,3),W(9,3),Z(3),M(3),N1(3),U(3),V(3),C(3,3),RANCE(3)  00002250 

00020'! 

DO  1  1  =  1  , N 

00002260 

000205 

N  1  (  1)^9 

00002270 

000206 

W(  1  ,  1  )  =  1  . 

00002280 

000207 

Wj 2.  1  )  =  4 . 

00002290 

000200 

W(  3.  1 )  =  2. 

00002300 

000209 

W(  4. 1 )  =  4. 

00002310 

000210 

W(  5, 1 )=2. 

00002320 

0002  1  1 

W  (  6  ,  1  )  =  4 . 

00002330 

0002  1  2 

W(  7,  1 )  =  2. 

00002340 

00021  3 

W(8. 1 )=4. 

00002350 

000214 

W(  9 .  1  )  =  1  . 

00002360 

000215 

1 

CONTI NUE 

00002370 

000216 

WSUM=0. 

00002380 

0002  1  7 

00  15  1  =  1  ,  N 

00002390 

000210 

X( 1.  1  )  =  U(  1  ) 

00002400 

000219 

RANGE (  1  )=V(  1  )-U(  1  ) 

00002410 

000220 

00  15  J=2 , 9 

00002420 

000221 

X( J .  1  )=X( J-1 ,  1  )  +  RANGE (  1 ) / 8 . 

00002430 

000222 

15 

CONTINUE 

00002440 

000223 

DO  10  1  =  1  ,  N 

00002450 

000224 

10 

M( 1 )=1 

00002460 

000225 

N2 -N+1 

000024  70 

000226 

ANS-0 . 

00002480 

000227 

6 

K  1 

00002490 

000228 

W 1  1  . 

00002500 

000229 

DO  2  1  =  1  . N 

00002510 

000230 

M 1  =  M(  1  ) 

00002520 

000231 

7 (  1  )  =  X( Ml ,  1  ) 

00002530 

000232 

2 

W 1  -  W1  **W(  Ml  ,  1  ) 

00002540 

000233 

WSUM=WSUM+W 1 

00002550 

000234 

AN S ~ ANS+W1 *  FUN ( 2 . C ,  N,  ERR) 

00002560 

000235 

8 

If (M(K)  -  N1(K)  )  3,4,5 

00002570 

000236 

5 

STOP 

00002580 

000237 

3 

M( K)=M( K)  +  1 

00002590 

000238 

GOTO  6 

00002600 

000239 

4 

M( K)-1 

00002610 

000240 

K-K  +  1 

0000262 0 

00024 1 

1 Ef k  -  N2)  8, 7.5 

00002630 

000242 

7 

A  - RANGE( 1  ) 

00002640 

000243 

1 f ( N  . EQ.  1 )  GO  TO  100 

00002650 

000244 

DO  50  1  =2 , N 

0000266U 

000245 

50 

A  -ARRANGE)  1  ) 

00002670 

000246 

1 00 

ANS  A#ANS/WSUM 

00002680 

00024  7 

RE  1  URN 

00002690 

000248 

END 

00002700 

(CUN’TT'.TK) 


1)2 


000249 


C 

C- 

C 

C 

C 

C 

c- 

c 


FUNCTION  PWLHAT  ( QL, QU ) 


SUBROUTINE  PWLEST  ESTIMATES  THE  PWL  VALUE 
USING  THE  QUALITY  INDEX  APPROACH 


000250 

000251 

000252 

000253 


IMPLICIT  REAL*4  (M) 
DIMENSION  PWL( 101 ),Z( 101 ) 
DATA  PWL/ 101 *0 . 0/ 


DATA 

Z/1 .5000, 

1  . 

4700, 1.4400, 1 

+ 

1.3200, 

1  . 

2900, 1.2600, 1 

+ 

1 .1400, 

1  . 

1 100, 1.0800, 1 

+ 

0.9600, 

0. 

9300,0.9000,0 

+ 

0.7800, 

0. 

7500,0.7200,0 

+ 

0.6000, 

0. 

5700,0.5400,0 

+ 

0  4200, 

0. 

3900,0.3600,0 

+ 

0.2400, 

0. 

2100,0.1800,0 

+ 

0.0600, 

0. 

0300,0.0000, - 

+ 

-0. 1200, 

-0 

. 1500,-0. 1800 

+ 

-0.2700, 

-0 

.3000,-0.3300 

+ 

-0.4200, 

-0 

.4500,-0.4800 

+ 

-0.5700, 

-0 

.6000,-0.6300 

+ 

-0.7200, 

-0 

. 7500,-0.7800 

+ 

-0.8700, 

-0 

.9000,-0.9300 

+ 

-1.0200, 

-1 

.0500,-1.0800 

+ 

-1.1700, 

-1 

.2000,-1.2300 

+ 

-1 . 3200, 

-1 

.3500,-1.3800 

+ 

-1.4700 

*  " 

1 .5000/ 

4100, 1.3800, 1.3500, 

2300, 1.2000, 1 .1700, 

0500, 1.0200,0.9900, 

8700,0.8400,0.8100, 

6900,0.6600,0.6300, 

5100,0.4800,0.4500, 

3300,0.3000,0.2700, 

1500,0. 1200,0.0900, 

.0300,-0.0600,-0.0900, 

-0.2100,-0.2400, 

-0.3600,-0.3900, 

-0.5100,-0.5400, 

-0.6600,-0.6900, 

-0.8100,-0.8400, 

-0.9600,-0.9900, 

-1.1100,-1.1400, 

-1.2600,-1.2900, 

-1.4100,-1.4400, 


000254 

DO  19  1=1,100 

000255 

PWL( 101-1 )=Z( 1 ) 

000256 

19 

CONTINUE 

000257 

1 F(QL.LT. PWL( 100) )  CO  TO  10 

000258 

PL  =  0.000 

000259 

GO  TO  40 

000260 

10 

DO  20  1  =  1,99 

000261 

JJ  =100-1 

000262 

AZZZ  =  PWL(JJ) 

000263 

IF(QL.GT.AZZZ)  GO  TO  30 

000264 

20 

CONTINUE 

000265 

PL  =  100.000 

000266 

PU  =  0.000 

000267 

GO  TO  80 

000268 

30 

F  =  ( QL-PWL( JJ ) ) / ( PWL( JJ+1 ) 

000269 

PL  =  1 00 . 000- JJ - F 

000270 

40 

1 F(QU. LT. PWL( 100) )  GO  TO  50 

000271 

PU  =  0.000 

000272 

GO  TO  80 

000273 

50 

DO  60  1  =  1,99 

000274 

JJ  =  100-1 

000275 

AZZZ  =  PWL(JJ) 

000276 

1  F(QU.GT. AZZZ)  GO  TO  70 

000277 

60 

CONTINUE 

000278 

PU  =  100.000 

000279 

GO  TO  80 

000280 

70 

F  =  (QU-PWL( JJ ) )/( PWL( JJ+1 )■ 

000281 

PU  =  100.000-JJ-F 

000282 

80 

PD  =  (  1 00 . 000- PU- PL ) 

000283 

PWLHAT  =  PD 

000284 

RETURN 

000285 

END 

PWL( JJ ) ) 


00002710 
00002720 
00002730 
00002/40 
00002750 
00002760 
000027  70 
•00002780 
00002790 
00002800 
00002810 
00002820 
00002830 
00002840 
00002850 
00002860 
00002870 
00002880 
00002890 
00002900 
00002910 
00002920 
00002930 
00002940 
00002950 
00002960 
00002970 
00002980 
00002990 
00003000 
00003010 
00003020 
00003030 
00003040 
00003050 
00003060 
00003070 
00003080 
00003090 
00003100 
00003110 
00003120 
00003130 
00003140 
00003150 
00003160 
00003170 
00003180 
00003190 
00003200 
00003210 
00003220 
00003230 
00003240 
00003250 
00003260 
00003270 
00003280 

00003290 

00003300 

00003310 

00003320 

00003330 


(CONTINUE) 


93 


000286 
0002 8 7 

000288 
000280 
001)290 
000291 
000202 
000293 
00029)1 
00029'* 
000296 
000297 
000298 
000299 
000300 
ooo  in  i 
000302 
000303 


SllBROU  I  I  NE  CAL  (  AV  .  COV,  US PFC , VSPEC . AC I  ) 

01  Ml  NS  JON  AV( 3 ) , OORR { 3,3), 

1  ST  D(  3 ) , COV( 3 . 3 ) . U( 3 ) , V( 3 ) , USPEC( 3 ) , VSPEC( 3  ) 
NSAHPL=4 
NVAR  = 3 

00  20  1=1, NVAR 
20  smi  I  )  =  SQRT  (  COV(  1,1)) 

00  30  1=1, NVAR 
00  25  J= 1 , NVAR 

25  CORK (  l,J)  =  COV(  I . J ) / ( ST  D(  I  ) »STD(  J ) ) 

U (  I  )  =  ( USPEC(  I  )-AV(  I  )  )  / S  TO (  I  ] 
v ( i )  (VSPEC( i ) - av ( i ) )/sro( i  i 
I  J  (  U  (  I  )  . LT.  -3.5)  U(  I  )  =  -3 . 5 
I  I  ( V (  I  )  . G T .  3.5)  V(  I  )=  3.5 
30  CONT I NUE 

(;.\|  j.  SUM iU.V.ANS.CORR.  NVAR,  ERR) 

AC  I  -  ANS 
Rt  1  )RN 
r  Nil 


00003390 
00003350 
00003360 
000033 70 
00003380 
00003390 
00003900 
00003910 
00003920 
00003930 
00003940 
00003450 
00003460 
00003470 
00003480 
00003490 
00003500 
00003510 
00003520 


END 

FILMED 

6-85 

DTIC 


